Aug 15 17:38:49 user nova-compute[73007]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 17:38:51 user nova-compute[73007]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73007) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 17:38:51 user nova-compute[73007]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73007) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 17:38:51 user nova-compute[73007]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73007) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 17:38:51 user nova-compute[73007]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:38:52 user nova-compute[73007]: INFO nova.virt.driver [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 17:38:52 user nova-compute[73007]: INFO nova.compute.provider_config [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] Acquiring lock "singleton_lock" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] Acquired lock "singleton_lock" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] Releasing lock "singleton_lock" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] Full set of CONF: {{(pid=73007) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ******************************************************************************** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] Configuration options gathered from: {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ================================================================================ {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] allow_resize_to_same_host      = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] arq_binding_timeout            = 300 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] backdoor_port                  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] backdoor_socket                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] block_device_allocate_retries  = 300 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] block_device_allocate_retries_interval = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cert                           = self.pem {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute_monitors               = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] config_dir                     = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] config_drive_format            = iso9660 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] config_source                  = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] console_host                   = user {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] control_exchange               = nova {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cpu_allocation_ratio           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] daemon                         = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] debug                          = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] default_access_ip_network_name = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] default_availability_zone      = nova {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] default_ephemeral_format       = ext4 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] default_schedule_zone          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] disk_allocation_ratio          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] enable_new_services            = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] enabled_apis                   = ['osapi_compute'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] enabled_ssl_apis               = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] flat_injected                  = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] force_config_drive             = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] force_raw_images               = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] graceful_shutdown_timeout      = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] heal_instance_info_cache_interval = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] host                           = user {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] instance_build_timeout         = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] instance_delete_interval       = 300 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] instance_format                = [instance: %(uuid)s]  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] instance_name_template         = instance-%08x {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] instance_usage_audit           = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] instance_usage_audit_period    = month {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] internal_service_availability_zone = internal {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] key                            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] live_migration_retry_count     = 30 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] log_config_append              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] log_dir                        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] log_file                       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] log_options                    = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] log_rotate_interval            = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] log_rotate_interval_type       = days {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] log_rotation_type              = none {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] long_rpc_timeout               = 1800 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] max_concurrent_builds          = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] max_concurrent_live_migrations = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] max_concurrent_snapshots       = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] max_local_block_devices        = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] max_logfile_count              = 30 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] max_logfile_size_mb            = 200 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] maximum_instance_delete_attempts = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] metadata_listen                = 0.0.0.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] metadata_listen_port           = 8775 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] metadata_workers               = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] migrate_max_retries            = -1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] mkisofs_cmd                    = genisoimage {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] my_ip                          = 10.0.0.210 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] network_allocate_retries       = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] osapi_compute_listen_port      = 8774 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] osapi_compute_unique_server_name_scope =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] osapi_compute_workers          = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] password_length                = 12 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] periodic_enable                = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] periodic_fuzzy_delay           = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] pointer_model                  = ps2mouse {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] preallocate_images             = none {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] publish_errors                 = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] pybasedir                      = /opt/stack/nova {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ram_allocation_ratio           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] rate_limit_burst               = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] rate_limit_except_level        = CRITICAL {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] rate_limit_interval            = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] reboot_timeout                 = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] reclaim_instance_interval      = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] record                         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] reimage_timeout_per_gb         = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] report_interval                = 120 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] rescue_timeout                 = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] reserved_host_cpus             = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] reserved_host_disk_mb          = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] reserved_host_memory_mb        = 512 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] reserved_huge_pages            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] resize_confirm_window          = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] resize_fs_using_block_device   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] resume_guests_state_on_host_boot = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] rpc_response_timeout           = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] run_external_periodic_tasks    = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] running_deleted_instance_action = reap {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] running_deleted_instance_poll_interval = 1800 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] running_deleted_instance_timeout = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler_instance_sync_interval = 120 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_down_time              = 720 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] servicegroup_driver            = db {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] shelved_offload_time           = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] shelved_poll_interval          = 3600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] shutdown_timeout               = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] source_is_ipv6                 = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ssl_only                       = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] state_path                     = /opt/stack/data/nova {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] sync_power_state_interval      = 600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] sync_power_state_pool_size     = 1000 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] syslog_log_facility            = LOG_USER {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] tempdir                        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] timeout_nbd                    = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] transport_url                  = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] update_resources_interval      = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] use_cow_images                 = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] use_eventlog                   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] use_journal                    = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] use_json                       = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] use_rootwrap_daemon            = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] use_stderr                     = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] use_syslog                     = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vcpu_pin_set                   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plugging_is_fatal          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plugging_timeout           = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] virt_mkfs                      = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] volume_usage_poll_interval     = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] watch_log_file                 = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] web                            = /usr/share/spice-html5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_concurrency.disable_process_locking = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.auth_strategy              = keystone {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.compute_link_prefix        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.dhcp_domain                = novalocal {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.enable_instance_password   = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.glance_link_prefix         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.instance_list_per_project_cells = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.list_records_by_skipping_down_cells = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.local_metadata_per_cell    = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.max_limit                  = 1000 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.metadata_cache_expiration  = 15 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.neutron_default_tenant_id  = default {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.use_forwarded_for          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.use_neutron_default_nets   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.vendordata_dynamic_targets = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.vendordata_jsonfile_path   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.backend                  = dogpile.cache.memcached {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.backend_argument         = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.config_prefix            = cache.oslo {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.dead_timeout             = 60.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.debug_cache_backend      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.enable_retry_client      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.enable_socket_keepalive  = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.enabled                  = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.expiration_time          = 600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.hashclient_retry_attempts = 2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_dead_retry      = 300 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_password        =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_pool_maxsize    = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_sasl_enabled    = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.memcache_username        =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.proxies                  = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.retry_attempts           = 2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.retry_delay              = 0.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.socket_keepalive_count   = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.socket_keepalive_idle    = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.socket_keepalive_interval = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.tls_allowed_ciphers      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.tls_cafile               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.tls_certfile             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.tls_enabled              = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cache.tls_keyfile              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.auth_section            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.auth_type               = password {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.cafile                  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.certfile                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.collect_timing          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.cross_az_attach         = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.debug                   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.endpoint_template       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.http_retries            = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.insecure                = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.keyfile                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.os_region_name          = RegionOne {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.split_loggers           = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cinder.timeout                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.cpu_dedicated_set      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.cpu_shared_set         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.image_type_exclude_list = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.max_concurrent_disk_ops = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.max_disk_devices_to_attach = -1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.resource_provider_association_refresh = 300 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.shutdown_retry_interval = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] conductor.workers              = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] console.allowed_origins        = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] console.ssl_ciphers            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] console.ssl_minimum_version    = default {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] consoleauth.token_ttl          = 600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.cafile                  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.certfile                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.collect_timing          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.connect_retries         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.connect_retry_delay     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.endpoint_override       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.insecure                = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.keyfile                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.max_version             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.min_version             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.region_name             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.service_name            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.service_type            = accelerator {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.split_loggers           = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.status_code_retries     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.status_code_retry_delay = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.timeout                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] cyborg.version                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.backend               = sqlalchemy {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.connection            = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.connection_debug      = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.connection_parameters =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.connection_recycle_time = 3600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.connection_trace      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.db_inc_retry_interval = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.db_max_retries        = 20 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.db_max_retry_interval = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.db_retry_interval     = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.max_overflow          = 50 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.max_pool_size         = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.max_retries           = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.mysql_enable_ndb      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.mysql_wsrep_sync_wait = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.pool_timeout          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.retry_interval        = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.slave_connection      = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] database.sqlite_synchronous    = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.backend           = sqlalchemy {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.connection        = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.connection_debug  = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.connection_parameters =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.connection_recycle_time = 3600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.connection_trace  = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.db_inc_retry_interval = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.db_max_retries    = 20 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.db_max_retry_interval = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.db_retry_interval = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.max_overflow      = 50 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.max_pool_size     = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.max_retries       = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.mysql_enable_ndb  = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.pool_timeout      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.retry_interval    = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.slave_connection  = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] api_database.sqlite_synchronous = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] devices.enabled_mdev_types     = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ephemeral_storage_encryption.enabled = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.api_servers             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.cafile                  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.certfile                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.collect_timing          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.connect_retries         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.connect_retry_delay     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.debug                   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.default_trusted_certificate_ids = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.enable_certificate_validation = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.enable_rbd_download     = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.endpoint_override       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.insecure                = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.keyfile                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.max_version             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.min_version             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.num_retries             = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.rbd_ceph_conf           =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.rbd_connect_timeout     = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.rbd_pool                =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.rbd_user                =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.region_name             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.service_name            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.service_type            = image {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.split_loggers           = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.status_code_retries     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.status_code_retry_delay = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.timeout                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.verify_glance_signatures = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] glance.version                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] guestfs.debug                  = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.config_drive_cdrom      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.config_drive_inject_password = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.enable_instance_metrics_collection = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.enable_remotefx         = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.instances_path_share    =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.iscsi_initiator_list    = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.limit_cpu_features      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.power_state_check_timeframe = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.use_multipath_io        = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.volume_attach_retry_count = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.vswitch_name            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] mks.enabled                    = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] image_cache.manager_interval   = 2400 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] image_cache.precache_concurrency = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] image_cache.remove_unused_base_images = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] image_cache.subdirectory_name  = _base {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.api_max_retries         = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.api_retry_interval      = 2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.auth_section            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.auth_type               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.cafile                  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.certfile                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.collect_timing          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.connect_retries         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.connect_retry_delay     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.endpoint_override       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.insecure                = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.keyfile                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.max_version             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.min_version             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.partition_key           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.peer_list               = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.region_name             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.serial_console_state_timeout = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.service_name            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.service_type            = baremetal {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.split_loggers           = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.status_code_retries     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.status_code_retry_delay = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.timeout                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ironic.version                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] key_manager.fixed_key          = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.barbican_api_version  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.barbican_endpoint     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.barbican_endpoint_type = public {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.barbican_region_name  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.cafile                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.certfile              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.collect_timing        = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.insecure              = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.keyfile               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.number_of_retries     = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.retry_delay           = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.send_service_user_token = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.split_loggers         = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.timeout               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.verify_ssl            = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican.verify_ssl_path       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.auth_section = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.auth_type = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.cafile   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.certfile = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.collect_timing = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.insecure = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.keyfile  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.split_loggers = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] barbican_service_user.timeout  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.approle_role_id          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.approle_secret_id        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.cafile                   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.certfile                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.collect_timing           = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.insecure                 = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.keyfile                  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.kv_mountpoint            = secret {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.kv_version               = 2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.namespace                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.root_token_id            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.split_loggers            = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.ssl_ca_crt_file          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.timeout                  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.use_ssl                  = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.cafile                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.certfile              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.collect_timing        = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.connect_retries       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.connect_retry_delay   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.endpoint_override     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.insecure              = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.keyfile               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.max_version           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.min_version           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.region_name           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.service_name          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.service_type          = identity {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.split_loggers         = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.status_code_retries   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.status_code_retry_delay = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.timeout               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] keystone.version               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.connection_uri         =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.cpu_mode               = custom {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: WARNING oslo_config.cfg [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.cpu_power_governor_high = performance {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.cpu_power_governor_low = powersave {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.cpu_power_management   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.device_detach_attempts = 8 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.device_detach_timeout  = 20 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.disk_cachemodes        = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.disk_prefix            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.enabled_perf_events    = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.file_backed_memory     = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.gid_maps               = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.hw_disk_discard        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.hw_machine_type        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.images_rbd_glance_store_name =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.images_rbd_pool        = rbd {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.images_type            = default {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.images_volume_group    = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.inject_key             = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.inject_partition       = -2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.inject_password        = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.iscsi_iface            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.iser_use_multipath     = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_bandwidth = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_downtime = 500 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_inbound_addr = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_permit_post_copy = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_scheme  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_timeout_action = abort {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_tunnelled = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: WARNING oslo_config.cfg [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 17:38:52 user nova-compute[73007]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 17:38:52 user nova-compute[73007]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 17:38:52 user nova-compute[73007]: and ``live_migration_inbound_addr`` respectively.
Aug 15 17:38:52 user nova-compute[73007]: ).  Its value may be silently ignored in the future.
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.live_migration_with_native_tls = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.max_queues             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.nfs_mount_options      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.num_memory_encrypted_guests = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.num_pcie_ports         = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.pmem_namespaces        = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.quobyte_client_cfg     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rbd_secret_uuid        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rbd_user               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.remote_filesystem_transport = ssh {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rescue_image_id        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rescue_kernel_id       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rescue_ramdisk_id      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.rx_queue_size          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.smbfs_mount_options    =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.snapshot_compression   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.snapshot_image_format  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.sparse_logical_volumes = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.swtpm_enabled          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.swtpm_group            = tss {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.swtpm_user             = tss {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.sysinfo_serial         = unique {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.tb_cache_size          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.tx_queue_size          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.uid_maps               = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.use_virtio_for_bridges = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.virt_type              = kvm {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.volume_clear           = zero {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.volume_clear_size      = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.volume_use_multipath   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.vzstorage_cache_path   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.vzstorage_mount_user   = stack {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.auth_section           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.auth_type              = password {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.cafile                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.certfile               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.collect_timing         = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.connect_retries        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.connect_retry_delay    = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.default_floating_pool  = public {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.endpoint_override      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.extension_sync_interval = 600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.http_retries           = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.insecure               = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.keyfile                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.max_version            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.min_version            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.ovs_bridge             = br-int {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.physnets               = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.region_name            = RegionOne {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.service_metadata_proxy = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.service_name           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.service_type           = network {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.split_loggers          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.status_code_retries    = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.status_code_retry_delay = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.timeout                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] neutron.version                = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] notifications.bdms_in_notifications = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] notifications.default_level    = INFO {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] notifications.notification_format = unversioned {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] notifications.notify_on_state_change = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] pci.alias                      = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] pci.device_spec                = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] pci.report_in_placement        = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.auth_section         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.auth_type            = password {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.cafile               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.certfile             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.collect_timing       = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.connect_retries      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.connect_retry_delay  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.default_domain_id    = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.default_domain_name  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.domain_id            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.domain_name          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.endpoint_override    = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.insecure             = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.keyfile              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.max_version          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.min_version          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.password             = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.project_domain_id    = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.project_domain_name  = Default {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.project_id           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.project_name         = service {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.region_name          = RegionOne {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.service_name         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.service_type         = placement {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.split_loggers        = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.status_code_retries  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.status_code_retry_delay = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.system_scope         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.timeout              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.trust_id             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.user_domain_id       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.user_domain_name     = Default {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.user_id              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.username             = placement {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] placement.version              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.cores                    = 20 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.count_usage_from_placement = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.injected_file_content_bytes = 10240 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.injected_file_path_length = 255 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.injected_files           = 5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.instances                = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.key_pairs                = 100 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.metadata_items           = 128 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.ram                      = 51200 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.recheck_quota            = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.server_group_members     = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] quota.server_groups            = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] rdp.enabled                    = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.image_metadata_prefilter = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.max_attempts         = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.max_placement_results = 1000 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.query_placement_for_availability_zone = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.query_placement_for_image_type_support = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] scheduler.workers              = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.host_subset_size = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.isolated_hosts = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.isolated_images = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.pci_in_placement = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.track_instance_changes = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] metrics.required               = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] metrics.weight_multiplier      = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] metrics.weight_setting         = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] serial_console.enabled         = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] serial_console.port_range      = 10000:20000 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] serial_console.serialproxy_port = 6083 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.auth_section      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.auth_type         = password {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.cafile            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.certfile          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.collect_timing    = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.insecure          = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.keyfile           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.send_service_user_token = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.split_loggers     = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] service_user.timeout           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.agent_enabled            = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.enabled                  = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.html5proxy_port          = 6082 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.image_compression        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.jpeg_compression         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.playback_compression     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.server_listen            = 127.0.0.1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.streaming_mode           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] spice.zlib_compression         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] upgrade_levels.baseapi         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] upgrade_levels.cert            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] upgrade_levels.compute         = auto {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] upgrade_levels.conductor       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] upgrade_levels.scheduler       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.auth_section = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.auth_type = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.cafile = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.certfile = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.insecure = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.keyfile = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vendordata_dynamic_auth.timeout = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.api_retry_count         = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.ca_file                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.cache_prefix            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.cluster_name            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.connection_pool_size    = 10 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.console_delay_seconds   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.datastore_regex         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.host_ip                 = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.host_password           = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.host_port               = 443 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.host_username           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.insecure                = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.integration_bridge      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.maximum_objects         = 100 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.pbm_default_policy      = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.pbm_enabled             = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.pbm_wsdl_location       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.serial_port_proxy_uri   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.serial_port_service_uri = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.task_poll_interval      = 0.5 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.use_linked_clone        = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.vnc_keymap              = en-us {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.vnc_port                = 5900 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vmware.vnc_port_total          = 10000 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.auth_schemes               = ['none'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.enabled                    = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.novncproxy_port            = 6080 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.server_listen              = 0.0.0.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.vencrypt_ca_certs          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.vencrypt_client_cert       = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vnc.vencrypt_client_key        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.disable_rootwrap   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.enable_numa_live_migration = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.libvirt_disable_apic = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.client_socket_timeout     = 900 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.default_pool_size         = 1000 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.keep_alive                = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.max_header_line           = 16384 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.ssl_ca_file               = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.ssl_cert_file             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.ssl_key_file              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.tcp_keepidle              = 600 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] zvm.ca_file                    = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] zvm.cloud_connector_url        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] zvm.reachable_timeout          = 300 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.enforce_new_defaults = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.enforce_scope      = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.policy_default_rule = default {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.policy_file        = policy.yaml {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.connection_string     = messaging:// {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.enabled               = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.es_doc_type           = notification {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.es_scroll_size        = 10000 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.es_scroll_time        = 2m {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.filter_error_trace    = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.hmac_keys             = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.sentinel_service_name = mymaster {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.socket_timeout        = 0.1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.trace_requests        = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler.trace_sqlalchemy      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler_jaeger.process_tags   = {} {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler_jaeger.service_name_prefix = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] profiler_otlp.service_name_prefix = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] remote_debug.host              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] remote_debug.port              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.ssl      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_notifications.retry = -1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_messaging_notifications.transport_url = **** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.auth_section        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.auth_type           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.cafile              = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.certfile            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.collect_timing      = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.connect_retries     = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.connect_retry_delay = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.endpoint_id         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.endpoint_override   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.insecure            = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.keyfile             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.max_version         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.min_version         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.region_name         = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.service_name        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.service_type        = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.split_loggers       = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.status_code_retries = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.status_code_retry_delay = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.timeout             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.valid_interfaces    = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_limit.version             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_reports.file_event_handler = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] oslo_reports.log_dir           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_ovs_privileged.group  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] vif_plug_ovs_privileged.user   = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_linux_bridge.flat_interface = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_ovs.isolate_vif         = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_vif_ovs.per_port_bridge     = False {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] os_brick.lock_path             = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] privsep_osbrick.capabilities   = [21] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] privsep_osbrick.group          = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] privsep_osbrick.helper_command = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] privsep_osbrick.user           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] nova_sys_admin.group           = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] nova_sys_admin.helper_command  = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] nova_sys_admin.user            = None {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG oslo_service.service [None req-0e447a0d-22a9-4717-b952-3ec405b3ce3f None None] ******************************************************************************** {{(pid=73007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 17:38:52 user nova-compute[73007]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 17:38:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Starting native event thread {{(pid=73007) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Starting green dispatch thread {{(pid=73007) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Starting connection event dispatch thread {{(pid=73007) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Connecting to libvirt: qemu:///system {{(pid=73007) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f11597e8d30> {{(pid=73007) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 17:38:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f11597e8d30> {{(pid=73007) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 17:38:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Connection event '1' reason 'None'
Aug 15 17:38:52 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 17:38:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.mount [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Initialising _HostMountState generation 0 {{(pid=73007) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 17:38:59 user nova-compute[73007]: INFO nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host capabilities <capabilities>
Aug 15 17:38:59 user nova-compute[73007]:   <host>
Aug 15 17:38:59 user nova-compute[73007]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 17:38:59 user nova-compute[73007]:     <cpu>
Aug 15 17:38:59 user nova-compute[73007]:       <arch>x86_64</arch>
Aug 15 17:38:59 user nova-compute[73007]:       <model>IvyBridge-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:38:59 user nova-compute[73007]:       <microcode version='1070'/>
Aug 15 17:38:59 user nova-compute[73007]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 17:38:59 user nova-compute[73007]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='ss'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='vmx'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='pcid'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='osxsave'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='hypervisor'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='arat'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='tsc_adjust'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='md-clear'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='stibp'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='arch-capabilities'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='ssbd'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='invtsc'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='rsba'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 17:38:59 user nova-compute[73007]:       <pages unit='KiB' size='4'/>
Aug 15 17:38:59 user nova-compute[73007]:       <pages unit='KiB' size='2048'/>
Aug 15 17:38:59 user nova-compute[73007]:     </cpu>
Aug 15 17:38:59 user nova-compute[73007]:     <power_management>
Aug 15 17:38:59 user nova-compute[73007]:       <suspend_mem/>
Aug 15 17:38:59 user nova-compute[73007]:       <suspend_disk/>
Aug 15 17:38:59 user nova-compute[73007]:       <suspend_hybrid/>
Aug 15 17:38:59 user nova-compute[73007]:     </power_management>
Aug 15 17:38:59 user nova-compute[73007]:     <iommu support='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     <migration_features>
Aug 15 17:38:59 user nova-compute[73007]:       <live/>
Aug 15 17:38:59 user nova-compute[73007]:       <uri_transports>
Aug 15 17:38:59 user nova-compute[73007]:         <uri_transport>tcp</uri_transport>
Aug 15 17:38:59 user nova-compute[73007]:         <uri_transport>rdma</uri_transport>
Aug 15 17:38:59 user nova-compute[73007]:       </uri_transports>
Aug 15 17:38:59 user nova-compute[73007]:     </migration_features>
Aug 15 17:38:59 user nova-compute[73007]:     <topology>
Aug 15 17:38:59 user nova-compute[73007]:       <cells num='2'>
Aug 15 17:38:59 user nova-compute[73007]:         <cell id='0'>
Aug 15 17:38:59 user nova-compute[73007]:           <memory unit='KiB'>8140616</memory>
Aug 15 17:38:59 user nova-compute[73007]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 15 17:38:59 user nova-compute[73007]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 17:38:59 user nova-compute[73007]:           <distances>
Aug 15 17:38:59 user nova-compute[73007]:             <sibling id='0' value='10'/>
Aug 15 17:38:59 user nova-compute[73007]:             <sibling id='1' value='20'/>
Aug 15 17:38:59 user nova-compute[73007]:           </distances>
Aug 15 17:38:59 user nova-compute[73007]:           <cpus num='6'>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 17:38:59 user nova-compute[73007]:           </cpus>
Aug 15 17:38:59 user nova-compute[73007]:         </cell>
Aug 15 17:38:59 user nova-compute[73007]:         <cell id='1'>
Aug 15 17:38:59 user nova-compute[73007]:           <memory unit='KiB'>8255068</memory>
Aug 15 17:38:59 user nova-compute[73007]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 15 17:38:59 user nova-compute[73007]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 17:38:59 user nova-compute[73007]:           <distances>
Aug 15 17:38:59 user nova-compute[73007]:             <sibling id='0' value='20'/>
Aug 15 17:38:59 user nova-compute[73007]:             <sibling id='1' value='10'/>
Aug 15 17:38:59 user nova-compute[73007]:           </distances>
Aug 15 17:38:59 user nova-compute[73007]:           <cpus num='6'>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 17:38:59 user nova-compute[73007]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 17:38:59 user nova-compute[73007]:           </cpus>
Aug 15 17:38:59 user nova-compute[73007]:         </cell>
Aug 15 17:38:59 user nova-compute[73007]:       </cells>
Aug 15 17:38:59 user nova-compute[73007]:     </topology>
Aug 15 17:38:59 user nova-compute[73007]:     <cache>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 17:38:59 user nova-compute[73007]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 17:38:59 user nova-compute[73007]:     </cache>
Aug 15 17:38:59 user nova-compute[73007]:     <secmodel>
Aug 15 17:38:59 user nova-compute[73007]:       <model>apparmor</model>
Aug 15 17:38:59 user nova-compute[73007]:       <doi>0</doi>
Aug 15 17:38:59 user nova-compute[73007]:     </secmodel>
Aug 15 17:38:59 user nova-compute[73007]:     <secmodel>
Aug 15 17:38:59 user nova-compute[73007]:       <model>dac</model>
Aug 15 17:38:59 user nova-compute[73007]:       <doi>0</doi>
Aug 15 17:38:59 user nova-compute[73007]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 17:38:59 user nova-compute[73007]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 17:38:59 user nova-compute[73007]:     </secmodel>
Aug 15 17:38:59 user nova-compute[73007]:   </host>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='alpha'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>clipper</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='armv6l'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>spitz</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>nuri</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>kzm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sx1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>z2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>tosa</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>n810</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>n800</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>terrier</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>midway</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>microbit</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>verdex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>highbank</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>akita</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>connex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>collie</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='armv7l'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>spitz</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>nuri</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>kzm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sx1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>z2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>tosa</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>n810</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>n800</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>terrier</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>midway</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>microbit</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>verdex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>highbank</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>akita</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>connex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>collie</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='aarch64'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>spitz</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>nuri</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>kzm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sx1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>z2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>tosa</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>n810</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>n800</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>terrier</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>midway</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>microbit</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>verdex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>highbank</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>akita</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>connex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>collie</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <acpi default='on' toggle='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='cris'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='i686'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>isapc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>microvm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='kvm'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <pae/>
Aug 15 17:38:59 user nova-compute[73007]:       <nonpae/>
Aug 15 17:38:59 user nova-compute[73007]:       <acpi default='on' toggle='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:       <apic default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='m68k'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>an5206</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>q800</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='microblaze'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='microblazeel'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='mips'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='16'>malta</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='mipsel'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='16'>malta</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='mips64'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='16'>malta</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>pica61</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>magnum</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='mips64el'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='16'>malta</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>pica61</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>magnum</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='16'>boston</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='ppc'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mac99</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>40p</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>taihu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='ppc64'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>taihu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>40p</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mac99</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='ppc64le'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>taihu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>40p</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>mac99</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='riscv32'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='8'>spike</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='8'>virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='riscv64'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='8'>spike</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='8'>virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='s390x'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='sh4'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>shix</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>r2d</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='sh4eb'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>shix</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>r2d</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='sparc'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>LX</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='sparc64'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>niagara</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='x86_64'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>64</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='1'>isapc</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>microvm</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='kvm'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <acpi default='on' toggle='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:       <apic default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='xtensa'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>sim</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>kc705</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>ml605</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>lx200</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>lx60</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]:   <guest>
Aug 15 17:38:59 user nova-compute[73007]:     <os_type>hvm</os_type>
Aug 15 17:38:59 user nova-compute[73007]:     <arch name='xtensaeb'>
Aug 15 17:38:59 user nova-compute[73007]:       <wordsize>32</wordsize>
Aug 15 17:38:59 user nova-compute[73007]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='4'>sim</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>kc705</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>ml605</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>virt</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>lx200</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>lx60</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 17:38:59 user nova-compute[73007]:       <domain type='qemu'/>
Aug 15 17:38:59 user nova-compute[73007]:     </arch>
Aug 15 17:38:59 user nova-compute[73007]:     <features>
Aug 15 17:38:59 user nova-compute[73007]:       <cpuselection/>
Aug 15 17:38:59 user nova-compute[73007]:       <deviceboot/>
Aug 15 17:38:59 user nova-compute[73007]:       <disksnapshot default='on' toggle='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     </features>
Aug 15 17:38:59 user nova-compute[73007]:   </guest>
Aug 15 17:38:59 user nova-compute[73007]: </capabilities>
Aug 15 17:38:59 user nova-compute[73007]: 
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 17:38:59 user nova-compute[73007]: <domainCapabilities>
Aug 15 17:38:59 user nova-compute[73007]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 17:38:59 user nova-compute[73007]:   <domain>kvm</domain>
Aug 15 17:38:59 user nova-compute[73007]:   <machine>pc-i440fx-jammy</machine>
Aug 15 17:38:59 user nova-compute[73007]:   <arch>i686</arch>
Aug 15 17:38:59 user nova-compute[73007]:   <vcpu max='255'/>
Aug 15 17:38:59 user nova-compute[73007]:   <iothreads supported='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:   <os supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:     <enum name='firmware'/>
Aug 15 17:38:59 user nova-compute[73007]:     <loader supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>rom</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>pflash</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='readonly'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>no</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='secure'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>no</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </loader>
Aug 15 17:38:59 user nova-compute[73007]:   </os>
Aug 15 17:38:59 user nova-compute[73007]:   <cpu>
Aug 15 17:38:59 user nova-compute[73007]:     <mode name='host-passthrough' supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='hostPassthroughMigratable'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>off</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </mode>
Aug 15 17:38:59 user nova-compute[73007]:     <mode name='maximum' supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='maximumMigratable'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>on</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>off</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </mode>
Aug 15 17:38:59 user nova-compute[73007]:     <mode name='host-model' supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='ss'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='vmx'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='pcid'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='hypervisor'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='arat'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='umip'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='md-clear'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='stibp'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='ssbd'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='ibpb'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='ibrs'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='amd-stibp'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='disable' name='erms'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='disable' name='lm'/>
Aug 15 17:38:59 user nova-compute[73007]:     </mode>
Aug 15 17:38:59 user nova-compute[73007]:     <mode name='custom' supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>qemu64</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>qemu32</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>phenom</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>pentium3</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>pentium2</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>pentium</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>n270</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>kvm64</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>kvm32</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>coreduo</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>core2duo</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>athlon</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Westmere</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Snowridge</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Server</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Client</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>SandyBridge</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Penryn</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G5</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G4</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G3</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G2</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G1</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Nehalem</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>IvyBridge</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Icelake-Server</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Haswell</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>EPYC-Rome</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>EPYC-Milan</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>EPYC</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Dhyana</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Cooperlake</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Conroe</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Broadwell</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>486</model>
Aug 15 17:38:59 user nova-compute[73007]:     </mode>
Aug 15 17:38:59 user nova-compute[73007]:   </cpu>
Aug 15 17:38:59 user nova-compute[73007]:   <memoryBacking supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:     <enum name='sourceType'>
Aug 15 17:38:59 user nova-compute[73007]:       <value>file</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>anonymous</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>memfd</value>
Aug 15 17:38:59 user nova-compute[73007]:     </enum>
Aug 15 17:38:59 user nova-compute[73007]:   </memoryBacking>
Aug 15 17:38:59 user nova-compute[73007]:   <devices>
Aug 15 17:38:59 user nova-compute[73007]:     <disk supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='diskDevice'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>disk</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>cdrom</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>floppy</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>lun</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='bus'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>ide</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>fdc</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>sata</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </disk>
Aug 15 17:38:59 user nova-compute[73007]:     <graphics supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>sdl</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>vnc</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>spice</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>egl-headless</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </graphics>
Aug 15 17:38:59 user nova-compute[73007]:     <video supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='modelType'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>vga</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>cirrus</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>vmvga</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>qxl</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>none</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>bochs</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>ramfb</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </video>
Aug 15 17:38:59 user nova-compute[73007]:     <hostdev supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='mode'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>subsystem</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='startupPolicy'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>default</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>mandatory</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>requisite</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>optional</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='subsysType'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>pci</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='capsType'/>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='pciBackend'/>
Aug 15 17:38:59 user nova-compute[73007]:     </hostdev>
Aug 15 17:38:59 user nova-compute[73007]:     <rng supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>random</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>egd</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>builtin</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </rng>
Aug 15 17:38:59 user nova-compute[73007]:     <filesystem supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='driverType'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>path</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>handle</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>virtiofs</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </filesystem>
Aug 15 17:38:59 user nova-compute[73007]:     <tpm supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>tpm-tis</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>tpm-crb</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>passthrough</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>emulator</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </tpm>
Aug 15 17:38:59 user nova-compute[73007]:   </devices>
Aug 15 17:38:59 user nova-compute[73007]:   <features>
Aug 15 17:38:59 user nova-compute[73007]:     <gic supported='no'/>
Aug 15 17:38:59 user nova-compute[73007]:     <vmcoreinfo supported='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:     <genid supported='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:     <backingStoreInput supported='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:     <backup supported='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:     <sev supported='no'/>
Aug 15 17:38:59 user nova-compute[73007]:   </features>
Aug 15 17:38:59 user nova-compute[73007]: </domainCapabilities>
Aug 15 17:38:59 user nova-compute[73007]:  {{(pid=73007) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 17:38:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 17:38:59 user nova-compute[73007]: <domainCapabilities>
Aug 15 17:38:59 user nova-compute[73007]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 17:38:59 user nova-compute[73007]:   <domain>kvm</domain>
Aug 15 17:38:59 user nova-compute[73007]:   <machine>pc-q35-6.2</machine>
Aug 15 17:38:59 user nova-compute[73007]:   <arch>i686</arch>
Aug 15 17:38:59 user nova-compute[73007]:   <vcpu max='288'/>
Aug 15 17:38:59 user nova-compute[73007]:   <iothreads supported='yes'/>
Aug 15 17:38:59 user nova-compute[73007]:   <os supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:     <enum name='firmware'/>
Aug 15 17:38:59 user nova-compute[73007]:     <loader supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>rom</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>pflash</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='readonly'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>no</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='secure'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>no</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </loader>
Aug 15 17:38:59 user nova-compute[73007]:   </os>
Aug 15 17:38:59 user nova-compute[73007]:   <cpu>
Aug 15 17:38:59 user nova-compute[73007]:     <mode name='host-passthrough' supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='hostPassthroughMigratable'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>off</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </mode>
Aug 15 17:38:59 user nova-compute[73007]:     <mode name='maximum' supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <enum name='maximumMigratable'>
Aug 15 17:38:59 user nova-compute[73007]:         <value>on</value>
Aug 15 17:38:59 user nova-compute[73007]:         <value>off</value>
Aug 15 17:38:59 user nova-compute[73007]:       </enum>
Aug 15 17:38:59 user nova-compute[73007]:     </mode>
Aug 15 17:38:59 user nova-compute[73007]:     <mode name='host-model' supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='ss'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='vmx'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='pcid'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='hypervisor'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='arat'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='umip'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='md-clear'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='stibp'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='ssbd'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='ibpb'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='ibrs'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='amd-stibp'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='disable' name='erms'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 17:38:59 user nova-compute[73007]:       <feature policy='disable' name='lm'/>
Aug 15 17:38:59 user nova-compute[73007]:     </mode>
Aug 15 17:38:59 user nova-compute[73007]:     <mode name='custom' supported='yes'>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>qemu64</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>qemu32</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>phenom</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>pentium3</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>pentium2</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>pentium</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>n270</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>kvm64</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>kvm32</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='yes'>coreduo</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>core2duo</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>athlon</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Westmere</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Snowridge</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Server</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Skylake-Client</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>SandyBridge</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Penryn</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G5</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G4</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G3</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G2</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Opteron_G1</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Nehalem</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>IvyBridge</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no'>Icelake-Server</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 17:38:59 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Rome</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Milan</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Dhyana</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cooperlake</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Conroe</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>486</model>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:   </cpu>
Aug 15 17:39:00 user nova-compute[73007]:   <memoryBacking supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='sourceType'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>file</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>anonymous</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>memfd</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:   </memoryBacking>
Aug 15 17:39:00 user nova-compute[73007]:   <devices>
Aug 15 17:39:00 user nova-compute[73007]:     <disk supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='diskDevice'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>disk</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cdrom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>floppy</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>lun</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='bus'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>fdc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sata</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </disk>
Aug 15 17:39:00 user nova-compute[73007]:     <graphics supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sdl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vnc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>spice</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egl-headless</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </graphics>
Aug 15 17:39:00 user nova-compute[73007]:     <video supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='modelType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cirrus</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vmvga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>qxl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>none</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>bochs</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ramfb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </video>
Aug 15 17:39:00 user nova-compute[73007]:     <hostdev supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='mode'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>subsystem</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='startupPolicy'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>default</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>mandatory</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>requisite</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>optional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='subsysType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pci</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='capsType'/>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='pciBackend'/>
Aug 15 17:39:00 user nova-compute[73007]:     </hostdev>
Aug 15 17:39:00 user nova-compute[73007]:     <rng supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>random</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egd</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>builtin</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </rng>
Aug 15 17:39:00 user nova-compute[73007]:     <filesystem supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='driverType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>path</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>handle</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtiofs</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </filesystem>
Aug 15 17:39:00 user nova-compute[73007]:     <tpm supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-tis</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-crb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>passthrough</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>emulator</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </tpm>
Aug 15 17:39:00 user nova-compute[73007]:   </devices>
Aug 15 17:39:00 user nova-compute[73007]:   <features>
Aug 15 17:39:00 user nova-compute[73007]:     <gic supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:     <vmcoreinfo supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <genid supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backingStoreInput supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backup supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <sev supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:   </features>
Aug 15 17:39:00 user nova-compute[73007]: </domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 17:39:00 user nova-compute[73007]: <domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 17:39:00 user nova-compute[73007]:   <domain>kvm</domain>
Aug 15 17:39:00 user nova-compute[73007]:   <machine>pc-q35-jammy</machine>
Aug 15 17:39:00 user nova-compute[73007]:   <arch>i686</arch>
Aug 15 17:39:00 user nova-compute[73007]:   <vcpu max='288'/>
Aug 15 17:39:00 user nova-compute[73007]:   <iothreads supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:   <os supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='firmware'/>
Aug 15 17:39:00 user nova-compute[73007]:     <loader supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>rom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pflash</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='readonly'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='secure'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </loader>
Aug 15 17:39:00 user nova-compute[73007]:   </os>
Aug 15 17:39:00 user nova-compute[73007]:   <cpu>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-passthrough' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='hostPassthroughMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='maximum' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='maximumMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-model' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ss'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='vmx'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pcid'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='hypervisor'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arat'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='umip'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='md-clear'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibpb'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibrs'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='erms'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='lm'/>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='custom' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>qemu64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>qemu32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>phenom</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>n270</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>kvm64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>coreduo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>core2duo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>athlon</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Westmere</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Snowridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Penryn</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G5</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G4</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G1</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Nehalem</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Rome</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Milan</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Dhyana</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cooperlake</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Conroe</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>486</model>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:   </cpu>
Aug 15 17:39:00 user nova-compute[73007]:   <memoryBacking supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='sourceType'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>file</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>anonymous</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>memfd</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:   </memoryBacking>
Aug 15 17:39:00 user nova-compute[73007]:   <devices>
Aug 15 17:39:00 user nova-compute[73007]:     <disk supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='diskDevice'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>disk</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cdrom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>floppy</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>lun</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='bus'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>fdc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sata</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </disk>
Aug 15 17:39:00 user nova-compute[73007]:     <graphics supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sdl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vnc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>spice</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egl-headless</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </graphics>
Aug 15 17:39:00 user nova-compute[73007]:     <video supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='modelType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cirrus</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vmvga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>qxl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>none</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>bochs</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ramfb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </video>
Aug 15 17:39:00 user nova-compute[73007]:     <hostdev supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='mode'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>subsystem</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='startupPolicy'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>default</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>mandatory</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>requisite</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>optional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='subsysType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pci</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='capsType'/>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='pciBackend'/>
Aug 15 17:39:00 user nova-compute[73007]:     </hostdev>
Aug 15 17:39:00 user nova-compute[73007]:     <rng supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>random</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egd</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>builtin</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </rng>
Aug 15 17:39:00 user nova-compute[73007]:     <filesystem supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='driverType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>path</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>handle</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtiofs</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </filesystem>
Aug 15 17:39:00 user nova-compute[73007]:     <tpm supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-tis</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-crb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>passthrough</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>emulator</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </tpm>
Aug 15 17:39:00 user nova-compute[73007]:   </devices>
Aug 15 17:39:00 user nova-compute[73007]:   <features>
Aug 15 17:39:00 user nova-compute[73007]:     <gic supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:     <vmcoreinfo supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <genid supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backingStoreInput supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backup supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <sev supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:   </features>
Aug 15 17:39:00 user nova-compute[73007]: </domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 17:39:00 user nova-compute[73007]: <domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 17:39:00 user nova-compute[73007]:   <domain>kvm</domain>
Aug 15 17:39:00 user nova-compute[73007]:   <machine>pc-i440fx-6.2</machine>
Aug 15 17:39:00 user nova-compute[73007]:   <arch>i686</arch>
Aug 15 17:39:00 user nova-compute[73007]:   <vcpu max='255'/>
Aug 15 17:39:00 user nova-compute[73007]:   <iothreads supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:   <os supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='firmware'/>
Aug 15 17:39:00 user nova-compute[73007]:     <loader supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>rom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pflash</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='readonly'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='secure'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </loader>
Aug 15 17:39:00 user nova-compute[73007]:   </os>
Aug 15 17:39:00 user nova-compute[73007]:   <cpu>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-passthrough' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='hostPassthroughMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='maximum' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='maximumMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-model' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ss'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='vmx'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pcid'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='hypervisor'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arat'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='umip'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='md-clear'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibpb'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibrs'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='erms'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='lm'/>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='custom' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>qemu64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>qemu32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>phenom</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>n270</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>kvm64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>coreduo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>core2duo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>athlon</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Westmere</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Snowridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Penryn</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G5</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G4</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G1</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Nehalem</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Rome</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Milan</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Dhyana</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cooperlake</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Conroe</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>486</model>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:   </cpu>
Aug 15 17:39:00 user nova-compute[73007]:   <memoryBacking supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='sourceType'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>file</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>anonymous</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>memfd</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:   </memoryBacking>
Aug 15 17:39:00 user nova-compute[73007]:   <devices>
Aug 15 17:39:00 user nova-compute[73007]:     <disk supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='diskDevice'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>disk</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cdrom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>floppy</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>lun</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='bus'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ide</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>fdc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sata</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </disk>
Aug 15 17:39:00 user nova-compute[73007]:     <graphics supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sdl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vnc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>spice</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egl-headless</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </graphics>
Aug 15 17:39:00 user nova-compute[73007]:     <video supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='modelType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cirrus</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vmvga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>qxl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>none</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>bochs</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ramfb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </video>
Aug 15 17:39:00 user nova-compute[73007]:     <hostdev supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='mode'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>subsystem</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='startupPolicy'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>default</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>mandatory</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>requisite</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>optional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='subsysType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pci</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='capsType'/>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='pciBackend'/>
Aug 15 17:39:00 user nova-compute[73007]:     </hostdev>
Aug 15 17:39:00 user nova-compute[73007]:     <rng supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>random</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egd</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>builtin</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </rng>
Aug 15 17:39:00 user nova-compute[73007]:     <filesystem supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='driverType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>path</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>handle</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtiofs</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </filesystem>
Aug 15 17:39:00 user nova-compute[73007]:     <tpm supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-tis</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-crb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>passthrough</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>emulator</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </tpm>
Aug 15 17:39:00 user nova-compute[73007]:   </devices>
Aug 15 17:39:00 user nova-compute[73007]:   <features>
Aug 15 17:39:00 user nova-compute[73007]:     <gic supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:     <vmcoreinfo supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <genid supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backingStoreInput supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backup supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <sev supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:   </features>
Aug 15 17:39:00 user nova-compute[73007]: </domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 17:39:00 user nova-compute[73007]: <domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 17:39:00 user nova-compute[73007]:   <domain>kvm</domain>
Aug 15 17:39:00 user nova-compute[73007]:   <machine>pc-i440fx-jammy</machine>
Aug 15 17:39:00 user nova-compute[73007]:   <arch>x86_64</arch>
Aug 15 17:39:00 user nova-compute[73007]:   <vcpu max='255'/>
Aug 15 17:39:00 user nova-compute[73007]:   <iothreads supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:   <os supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='firmware'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>efi</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:     <loader supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>rom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pflash</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='readonly'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='secure'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </loader>
Aug 15 17:39:00 user nova-compute[73007]:   </os>
Aug 15 17:39:00 user nova-compute[73007]:   <cpu>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-passthrough' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='hostPassthroughMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='maximum' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='maximumMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-model' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ss'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='vmx'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pcid'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='hypervisor'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arat'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='umip'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='md-clear'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='invtsc'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibpb'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibrs'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='rsba'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='erms'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='custom' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>qemu64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>qemu32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>phenom</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>n270</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>coreduo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>core2duo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>athlon</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Westmere</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Snowridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Penryn</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G5</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G4</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Opteron_G1</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Nehalem</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Rome</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Milan</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Dhyana</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cooperlake</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Conroe</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>486</model>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:   </cpu>
Aug 15 17:39:00 user nova-compute[73007]:   <memoryBacking supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='sourceType'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>file</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>anonymous</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>memfd</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:   </memoryBacking>
Aug 15 17:39:00 user nova-compute[73007]:   <devices>
Aug 15 17:39:00 user nova-compute[73007]:     <disk supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='diskDevice'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>disk</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cdrom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>floppy</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>lun</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='bus'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ide</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>fdc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sata</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </disk>
Aug 15 17:39:00 user nova-compute[73007]:     <graphics supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sdl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vnc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>spice</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egl-headless</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </graphics>
Aug 15 17:39:00 user nova-compute[73007]:     <video supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='modelType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cirrus</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vmvga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>qxl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>none</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>bochs</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ramfb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </video>
Aug 15 17:39:00 user nova-compute[73007]:     <hostdev supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='mode'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>subsystem</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='startupPolicy'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>default</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>mandatory</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>requisite</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>optional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='subsysType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pci</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='capsType'/>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='pciBackend'/>
Aug 15 17:39:00 user nova-compute[73007]:     </hostdev>
Aug 15 17:39:00 user nova-compute[73007]:     <rng supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>random</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egd</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>builtin</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </rng>
Aug 15 17:39:00 user nova-compute[73007]:     <filesystem supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='driverType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>path</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>handle</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtiofs</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </filesystem>
Aug 15 17:39:00 user nova-compute[73007]:     <tpm supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-tis</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-crb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>passthrough</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>emulator</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </tpm>
Aug 15 17:39:00 user nova-compute[73007]:   </devices>
Aug 15 17:39:00 user nova-compute[73007]:   <features>
Aug 15 17:39:00 user nova-compute[73007]:     <gic supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:     <vmcoreinfo supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <genid supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backingStoreInput supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backup supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <sev supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:   </features>
Aug 15 17:39:00 user nova-compute[73007]: </domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 17:39:00 user nova-compute[73007]: <domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 17:39:00 user nova-compute[73007]:   <domain>kvm</domain>
Aug 15 17:39:00 user nova-compute[73007]:   <machine>pc-q35-6.2</machine>
Aug 15 17:39:00 user nova-compute[73007]:   <arch>x86_64</arch>
Aug 15 17:39:00 user nova-compute[73007]:   <vcpu max='288'/>
Aug 15 17:39:00 user nova-compute[73007]:   <iothreads supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:   <os supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='firmware'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>efi</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:     <loader supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>rom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pflash</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='readonly'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='secure'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </loader>
Aug 15 17:39:00 user nova-compute[73007]:   </os>
Aug 15 17:39:00 user nova-compute[73007]:   <cpu>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-passthrough' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='hostPassthroughMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='maximum' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='maximumMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-model' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ss'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='vmx'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pcid'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='hypervisor'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arat'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='umip'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='md-clear'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='invtsc'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibpb'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibrs'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='rsba'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='erms'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='custom' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>qemu64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>qemu32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>phenom</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>n270</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>coreduo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>core2duo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>athlon</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Westmere</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Snowridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Penryn</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G5</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G4</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Opteron_G1</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Nehalem</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Rome</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Milan</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Dhyana</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cooperlake</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Conroe</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>486</model>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:   </cpu>
Aug 15 17:39:00 user nova-compute[73007]:   <memoryBacking supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='sourceType'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>file</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>anonymous</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>memfd</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:   </memoryBacking>
Aug 15 17:39:00 user nova-compute[73007]:   <devices>
Aug 15 17:39:00 user nova-compute[73007]:     <disk supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='diskDevice'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>disk</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cdrom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>floppy</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>lun</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='bus'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>fdc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sata</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </disk>
Aug 15 17:39:00 user nova-compute[73007]:     <graphics supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sdl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vnc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>spice</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egl-headless</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </graphics>
Aug 15 17:39:00 user nova-compute[73007]:     <video supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='modelType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cirrus</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vmvga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>qxl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>none</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>bochs</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ramfb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </video>
Aug 15 17:39:00 user nova-compute[73007]:     <hostdev supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='mode'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>subsystem</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='startupPolicy'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>default</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>mandatory</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>requisite</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>optional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='subsysType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pci</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='capsType'/>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='pciBackend'/>
Aug 15 17:39:00 user nova-compute[73007]:     </hostdev>
Aug 15 17:39:00 user nova-compute[73007]:     <rng supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>random</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egd</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>builtin</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </rng>
Aug 15 17:39:00 user nova-compute[73007]:     <filesystem supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='driverType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>path</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>handle</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtiofs</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </filesystem>
Aug 15 17:39:00 user nova-compute[73007]:     <tpm supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-tis</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-crb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>passthrough</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>emulator</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </tpm>
Aug 15 17:39:00 user nova-compute[73007]:   </devices>
Aug 15 17:39:00 user nova-compute[73007]:   <features>
Aug 15 17:39:00 user nova-compute[73007]:     <gic supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:     <vmcoreinfo supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <genid supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backingStoreInput supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backup supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <sev supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:   </features>
Aug 15 17:39:00 user nova-compute[73007]: </domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 17:39:00 user nova-compute[73007]: <domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 17:39:00 user nova-compute[73007]:   <domain>kvm</domain>
Aug 15 17:39:00 user nova-compute[73007]:   <machine>pc-q35-jammy</machine>
Aug 15 17:39:00 user nova-compute[73007]:   <arch>x86_64</arch>
Aug 15 17:39:00 user nova-compute[73007]:   <vcpu max='288'/>
Aug 15 17:39:00 user nova-compute[73007]:   <iothreads supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:   <os supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='firmware'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>efi</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:     <loader supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>rom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pflash</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='readonly'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='secure'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </loader>
Aug 15 17:39:00 user nova-compute[73007]:   </os>
Aug 15 17:39:00 user nova-compute[73007]:   <cpu>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-passthrough' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='hostPassthroughMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='maximum' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='maximumMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-model' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ss'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='vmx'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pcid'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='hypervisor'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arat'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='umip'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='md-clear'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='invtsc'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibpb'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibrs'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='rsba'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='erms'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='custom' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>qemu64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>qemu32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>phenom</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>n270</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>coreduo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>core2duo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>athlon</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Westmere</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Snowridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Penryn</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G5</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G4</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Opteron_G1</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Nehalem</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Rome</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Milan</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Dhyana</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cooperlake</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Conroe</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>486</model>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:   </cpu>
Aug 15 17:39:00 user nova-compute[73007]:   <memoryBacking supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='sourceType'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>file</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>anonymous</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>memfd</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:   </memoryBacking>
Aug 15 17:39:00 user nova-compute[73007]:   <devices>
Aug 15 17:39:00 user nova-compute[73007]:     <disk supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='diskDevice'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>disk</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cdrom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>floppy</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>lun</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='bus'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>fdc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sata</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </disk>
Aug 15 17:39:00 user nova-compute[73007]:     <graphics supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sdl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vnc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>spice</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egl-headless</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </graphics>
Aug 15 17:39:00 user nova-compute[73007]:     <video supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='modelType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cirrus</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vmvga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>qxl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>none</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>bochs</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ramfb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </video>
Aug 15 17:39:00 user nova-compute[73007]:     <hostdev supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='mode'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>subsystem</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='startupPolicy'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>default</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>mandatory</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>requisite</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>optional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='subsysType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pci</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='capsType'/>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='pciBackend'/>
Aug 15 17:39:00 user nova-compute[73007]:     </hostdev>
Aug 15 17:39:00 user nova-compute[73007]:     <rng supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>random</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egd</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>builtin</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </rng>
Aug 15 17:39:00 user nova-compute[73007]:     <filesystem supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='driverType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>path</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>handle</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtiofs</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </filesystem>
Aug 15 17:39:00 user nova-compute[73007]:     <tpm supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-tis</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-crb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>passthrough</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>emulator</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </tpm>
Aug 15 17:39:00 user nova-compute[73007]:   </devices>
Aug 15 17:39:00 user nova-compute[73007]:   <features>
Aug 15 17:39:00 user nova-compute[73007]:     <gic supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:     <vmcoreinfo supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <genid supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backingStoreInput supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backup supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <sev supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:   </features>
Aug 15 17:39:00 user nova-compute[73007]: </domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 17:39:00 user nova-compute[73007]: <domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 17:39:00 user nova-compute[73007]:   <domain>kvm</domain>
Aug 15 17:39:00 user nova-compute[73007]:   <machine>pc-i440fx-6.2</machine>
Aug 15 17:39:00 user nova-compute[73007]:   <arch>x86_64</arch>
Aug 15 17:39:00 user nova-compute[73007]:   <vcpu max='255'/>
Aug 15 17:39:00 user nova-compute[73007]:   <iothreads supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:   <os supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='firmware'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>efi</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:     <loader supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>rom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pflash</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='readonly'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>yes</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='secure'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>no</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </loader>
Aug 15 17:39:00 user nova-compute[73007]:   </os>
Aug 15 17:39:00 user nova-compute[73007]:   <cpu>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-passthrough' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='hostPassthroughMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='maximum' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='maximumMigratable'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>on</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>off</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='host-model' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <vendor>Intel</vendor>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ss'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='vmx'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pcid'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='hypervisor'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arat'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='umip'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='md-clear'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='invtsc'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibpb'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='ibrs'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-stibp'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='rsba'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='erms'/>
Aug 15 17:39:00 user nova-compute[73007]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:     <mode name='custom' supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>qemu64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>qemu32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>phenom</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>pentium</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>n270</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm64</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>kvm32</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>coreduo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>core2duo</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>athlon</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Westmere</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Snowridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Skylake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>SandyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Penryn</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G5</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G4</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G3</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Opteron_G2</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Opteron_G1</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Nehalem</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>IvyBridge</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Icelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Haswell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Rome</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-Milan</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>EPYC</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Dhyana</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cooperlake</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>Conroe</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='no'>Broadwell</model>
Aug 15 17:39:00 user nova-compute[73007]:       <model usable='yes'>486</model>
Aug 15 17:39:00 user nova-compute[73007]:     </mode>
Aug 15 17:39:00 user nova-compute[73007]:   </cpu>
Aug 15 17:39:00 user nova-compute[73007]:   <memoryBacking supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:     <enum name='sourceType'>
Aug 15 17:39:00 user nova-compute[73007]:       <value>file</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>anonymous</value>
Aug 15 17:39:00 user nova-compute[73007]:       <value>memfd</value>
Aug 15 17:39:00 user nova-compute[73007]:     </enum>
Aug 15 17:39:00 user nova-compute[73007]:   </memoryBacking>
Aug 15 17:39:00 user nova-compute[73007]:   <devices>
Aug 15 17:39:00 user nova-compute[73007]:     <disk supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='diskDevice'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>disk</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cdrom</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>floppy</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>lun</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='bus'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ide</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>fdc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sata</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </disk>
Aug 15 17:39:00 user nova-compute[73007]:     <graphics supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='type'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>sdl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vnc</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>spice</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egl-headless</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </graphics>
Aug 15 17:39:00 user nova-compute[73007]:     <video supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='modelType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>cirrus</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>vmvga</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>qxl</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>none</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>bochs</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>ramfb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </video>
Aug 15 17:39:00 user nova-compute[73007]:     <hostdev supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='mode'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>subsystem</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='startupPolicy'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>default</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>mandatory</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>requisite</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>optional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='subsysType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>usb</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>pci</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>scsi</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='capsType'/>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='pciBackend'/>
Aug 15 17:39:00 user nova-compute[73007]:     </hostdev>
Aug 15 17:39:00 user nova-compute[73007]:     <rng supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtio-non-transitional</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>random</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>egd</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>builtin</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </rng>
Aug 15 17:39:00 user nova-compute[73007]:     <filesystem supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='driverType'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>path</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>handle</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>virtiofs</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </filesystem>
Aug 15 17:39:00 user nova-compute[73007]:     <tpm supported='yes'>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='model'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-tis</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>tpm-crb</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:       <enum name='backendModel'>
Aug 15 17:39:00 user nova-compute[73007]:         <value>passthrough</value>
Aug 15 17:39:00 user nova-compute[73007]:         <value>emulator</value>
Aug 15 17:39:00 user nova-compute[73007]:       </enum>
Aug 15 17:39:00 user nova-compute[73007]:     </tpm>
Aug 15 17:39:00 user nova-compute[73007]:   </devices>
Aug 15 17:39:00 user nova-compute[73007]:   <features>
Aug 15 17:39:00 user nova-compute[73007]:     <gic supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:     <vmcoreinfo supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <genid supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backingStoreInput supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <backup supported='yes'/>
Aug 15 17:39:00 user nova-compute[73007]:     <sev supported='no'/>
Aug 15 17:39:00 user nova-compute[73007]:   </features>
Aug 15 17:39:00 user nova-compute[73007]: </domainCapabilities>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73007) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73007) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Checking secure boot support for host arch (x86_64) {{(pid=73007) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Checking secure boot support for host arch (x86_64) {{(pid=73007) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Checking secure boot support for host arch (x86_64) {{(pid=73007) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 17:39:00 user nova-compute[73007]: INFO nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Secure Boot support detected
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] cpu compare xml: <cpu match="exact">
Aug 15 17:39:00 user nova-compute[73007]:   <model>Nehalem</model>
Aug 15 17:39:00 user nova-compute[73007]: </cpu>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 17:39:00 user nova-compute[73007]: INFO nova.virt.node [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Generated node identity 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d
Aug 15 17:39:00 user nova-compute[73007]: INFO nova.virt.node [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Wrote node identity 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d to /opt/stack/data/nova/compute_id
Aug 15 17:39:00 user nova-compute[73007]: WARNING nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Compute nodes ['2c62a5a4-d74d-43ad-a53c-fdd8c74e177d'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 17:39:00 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 17:39:00 user nova-compute[73007]: WARNING nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 17:39:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:39:00 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:39:00 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Hypervisor/Node resource view: name=user free_ram=10889MB free_disk=26.296314239501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:39:00 user nova-compute[73007]: WARNING nova.compute.resource_tracker [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] No compute node record for user:2c62a5a4-d74d-43ad-a53c-fdd8c74e177d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d could not be found.
Aug 15 17:39:00 user nova-compute[73007]: INFO nova.compute.resource_tracker [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Compute node record created for user:user with uuid: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:39:00 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [req-a0a66946-ed16-4b73-8ee2-e2bb47e9de04] Created resource provider record via placement API for resource provider with UUID 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d and name user.
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73007) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 17:39:00 user nova-compute[73007]: INFO nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] kernel doesn't support AMD SEV
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:39:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Libvirt baseline CPU <cpu>
Aug 15 17:39:00 user nova-compute[73007]:   <arch>x86_64</arch>
Aug 15 17:39:00 user nova-compute[73007]:   <model>Nehalem</model>
Aug 15 17:39:00 user nova-compute[73007]:   <vendor>Intel</vendor>
Aug 15 17:39:00 user nova-compute[73007]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 17:39:00 user nova-compute[73007]: </cpu>
Aug 15 17:39:00 user nova-compute[73007]:  {{(pid=73007) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Updated inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Updating resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d generation from 0 to 1 during operation: update_inventory {{(pid=73007) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Updating resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d generation from 1 to 2 during operation: update_traits {{(pid=73007) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG nova.service [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Creating RPC server for service compute {{(pid=73007) start /opt/stack/nova/nova/service.py:182}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG nova.service [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Join ServiceGroup membership for this service compute {{(pid=73007) start /opt/stack/nova/nova/service.py:199}}
Aug 15 17:39:01 user nova-compute[73007]: DEBUG nova.servicegroup.drivers.db [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73007) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:39:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:39:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=10197MB free_disk=26.200027465820312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:39:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:40:53 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:40:53 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=10197MB free_disk=26.246078491210938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:40:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:40:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:40:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:41:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:53 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:41:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:41:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 17:41:53 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:53 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:41:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:41:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:41:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=26.03144073486328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:41:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:41:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:41:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:42:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:53 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:42:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:42:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:42:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:42:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:42:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=9522MB free_disk=26.062042236328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:42:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:42:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:56 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:57 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:42:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:10 user nova-compute[73007]: INFO nova.compute.claims [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Claim successful on node user
Aug 15 17:43:10 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Creating image(s)
Aug 15 17:43:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "/opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "/opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG nova.policy [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec7a834c29d64d0daedb7d6dc62d7315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead6fc5ea8ef44a185d73923e9d50208', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5.part --force-share --output=json" returned: 0 in 0.170s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG nova.virt.images [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] ebea4084-739d-4b93-af7c-d6ebe6897cd3 was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:43:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5.part /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5.part /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5.converted" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5.converted --force-share --output=json" returned: 0 in 0.161s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.908s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:12 user nova-compute[73007]: INFO oslo.privsep.daemon [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpltx9kymt/privsep.sock']
Aug 15 17:43:12 user sudo[82231]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpltx9kymt/privsep.sock
Aug 15 17:43:12 user sudo[82231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 17:43:14 user sudo[82231]: pam_unix(sudo:session): session closed for user root
Aug 15 17:43:14 user nova-compute[73007]: INFO oslo.privsep.daemon [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Spawned new privsep daemon via rootwrap
Aug 15 17:43:14 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 17:43:14 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 17:43:14 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 17:43:14 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82238
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Successfully created port: 238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:14 user nova-compute[73007]: INFO nova.compute.claims [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Claim successful on node user
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.165s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk 1073741824" returned: 0 in 0.063s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:14 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Creating image(s)
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.policy [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '206f089e51fd4e8f842a5584b630c736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4727295cc556413eb5dd6ca0d10f50e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Cannot resize image /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.objects.instance [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lazy-loading 'migration_context' on Instance uuid 1a098861-c387-4883-9d2c-e69ad9a7760a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Ensure instance console log exists: /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.164s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk 1073741824" returned: 0 in 0.045s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Cannot resize image /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'migration_context' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Ensure instance console log exists: /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:16 user nova-compute[73007]: INFO nova.compute.claims [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Claim successful on node user
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.213s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:16 user nova-compute[73007]: INFO nova.compute.claims [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Claim successful on node user
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.network.neutron [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Creating image(s)
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "/opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "/opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:16 user nova-compute[73007]: DEBUG nova.policy [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82906484a46f4ad0be9a602aec2affb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa702dd2884da4b28a84db913819b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:17 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Creating image(s)
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.211s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk 1073741824" returned: 0 in 0.043s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.208s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.169s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.policy [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1395246c93fc4c0dac8d95fffefd9711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1deb9da1fb54f8b8968f01265347c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk 1073741824" returned: 0 in 0.047s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Cannot resize image /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.objects.instance [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'migration_context' on Instance uuid fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Ensure instance console log exists: /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Successfully created port: ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Cannot resize image /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'migration_context' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Ensure instance console log exists: /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Successfully updated port: 238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquired lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:18 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:18 user nova-compute[73007]: INFO nova.compute.claims [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Claim successful on node user
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-866fa963-91b0-460e-92ed-e0181b45e130 req-9fd17f5e-d1dc-4962-90c7-88521538ca39 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received event network-changed-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-866fa963-91b0-460e-92ed-e0181b45e130 req-9fd17f5e-d1dc-4962-90c7-88521538ca39 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Refreshing instance network info cache due to event network-changed-238f4b21-1dbe-4870-8282-cc0c11449862. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-866fa963-91b0-460e-92ed-e0181b45e130 req-9fd17f5e-d1dc-4962-90c7-88521538ca39 service nova] Acquiring lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Creating image(s)
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.164s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG nova.policy [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6f13824fa664d9ca209ec7b4d826bdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '097ecc4c5c86438b94fd930ca13f47dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk 1073741824" returned: 0 in 0.057s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.169s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Cannot resize image /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'migration_context' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Ensure instance console log exists: /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Updating instance_info_cache with network_info: [{"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Releasing lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Instance network_info: |[{"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-866fa963-91b0-460e-92ed-e0181b45e130 req-9fd17f5e-d1dc-4962-90c7-88521538ca39 service nova] Acquired lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-866fa963-91b0-460e-92ed-e0181b45e130 req-9fd17f5e-d1dc-4962-90c7-88521538ca39 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Refreshing network info cache for port 238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Start _get_guest_xml network_info=[{"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:20 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:20 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1295434145',display_name='tempest-DeleteServersTestJSON-server-1295434145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1295434145',id=1,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ead6fc5ea8ef44a185d73923e9d50208',ramdisk_id='',reservation_id='r-ww1h92d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-235019230',owner_user_name='tempest-DeleteServersTestJSON-235019230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:11Z,user_data=None,user_id='ec7a834c29d64d0daedb7d6dc62d7315',uuid=1a098861-c387-4883-9d2c-e69ad9a7760a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Converting VIF {"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:b4,bridge_name='br-int',has_traffic_filtering=True,id=238f4b21-1dbe-4870-8282-cc0c11449862,network=Network(39470a92-679f-4036-b7f1-d4e220ec70da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f4b21-1d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:20 user nova-compute[73007]: DEBUG nova.objects.instance [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a098861-c387-4883-9d2c-e69ad9a7760a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:21 user nova-compute[73007]:   <uuid>1a098861-c387-4883-9d2c-e69ad9a7760a</uuid>
Aug 15 17:43:21 user nova-compute[73007]:   <name>instance-00000001</name>
Aug 15 17:43:21 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:21 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:21 user nova-compute[73007]:   <metadata>
Aug 15 17:43:21 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:21 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:21 user nova-compute[73007]:       <nova:name>tempest-DeleteServersTestJSON-server-1295434145</nova:name>
Aug 15 17:43:21 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:20</nova:creationTime>
Aug 15 17:43:21 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:21 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:21 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:21 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:21 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:21 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:21 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:21 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:21 user nova-compute[73007]:         <nova:user uuid="ec7a834c29d64d0daedb7d6dc62d7315">tempest-DeleteServersTestJSON-235019230-project-member</nova:user>
Aug 15 17:43:21 user nova-compute[73007]:         <nova:project uuid="ead6fc5ea8ef44a185d73923e9d50208">tempest-DeleteServersTestJSON-235019230</nova:project>
Aug 15 17:43:21 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:21 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:43:21 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:21 user nova-compute[73007]:         <nova:port uuid="238f4b21-1dbe-4870-8282-cc0c11449862">
Aug 15 17:43:21 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 17:43:21 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:21 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:21 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:21 user nova-compute[73007]:   </metadata>
Aug 15 17:43:21 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:21 user nova-compute[73007]:     <system>
Aug 15 17:43:21 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:21 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:21 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:21 user nova-compute[73007]:       <entry name="serial">1a098861-c387-4883-9d2c-e69ad9a7760a</entry>
Aug 15 17:43:21 user nova-compute[73007]:       <entry name="uuid">1a098861-c387-4883-9d2c-e69ad9a7760a</entry>
Aug 15 17:43:21 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:21 user nova-compute[73007]:     </system>
Aug 15 17:43:21 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:21 user nova-compute[73007]:   <os>
Aug 15 17:43:21 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:21 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:21 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:21 user nova-compute[73007]:   </os>
Aug 15 17:43:21 user nova-compute[73007]:   <features>
Aug 15 17:43:21 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:21 user nova-compute[73007]:     <apic/>
Aug 15 17:43:21 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:21 user nova-compute[73007]:   </features>
Aug 15 17:43:21 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:21 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:21 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:21 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:21 user nova-compute[73007]:   </clock>
Aug 15 17:43:21 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:21 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:21 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:21 user nova-compute[73007]:   </cpu>
Aug 15 17:43:21 user nova-compute[73007]:   <devices>
Aug 15 17:43:21 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:21 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:21 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk"/>
Aug 15 17:43:21 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:43:21 user nova-compute[73007]:     </disk>
Aug 15 17:43:21 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:21 user nova-compute[73007]:       <mac address="fa:16:3e:91:3e:b4"/>
Aug 15 17:43:21 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:21 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:21 user nova-compute[73007]:       <target dev="tap238f4b21-1d"/>
Aug 15 17:43:21 user nova-compute[73007]:     </interface>
Aug 15 17:43:21 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:21 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/console.log" append="off"/>
Aug 15 17:43:21 user nova-compute[73007]:     </serial>
Aug 15 17:43:21 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:21 user nova-compute[73007]:     <video>
Aug 15 17:43:21 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:21 user nova-compute[73007]:     </video>
Aug 15 17:43:21 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:21 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:21 user nova-compute[73007]:     </rng>
Aug 15 17:43:21 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:21 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:21 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:21 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:21 user nova-compute[73007]:   </devices>
Aug 15 17:43:21 user nova-compute[73007]: </domain>
Aug 15 17:43:21 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1295434145',display_name='tempest-DeleteServersTestJSON-server-1295434145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1295434145',id=1,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ead6fc5ea8ef44a185d73923e9d50208',ramdisk_id='',reservation_id='r-ww1h92d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-235019230',owner_user_name='tempest-DeleteServersTestJSON-235019230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:11Z,user_data=None,user_id='ec7a834c29d64d0daedb7d6dc62d7315',uuid=1a098861-c387-4883-9d2c-e69ad9a7760a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Converting VIF {"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:b4,bridge_name='br-int',has_traffic_filtering=True,id=238f4b21-1dbe-4870-8282-cc0c11449862,network=Network(39470a92-679f-4036-b7f1-d4e220ec70da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f4b21-1d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG os_vif [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:b4,bridge_name='br-int',has_traffic_filtering=True,id=238f4b21-1dbe-4870-8282-cc0c11449862,network=Network(39470a92-679f-4036-b7f1-d4e220ec70da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f4b21-1d') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Created schema index Interface.name {{(pid=73007) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Created schema index Port.name {{(pid=73007) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Created schema index Bridge.name {{(pid=73007) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG nova.network.neutron [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Successfully created port: 4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [POLLOUT] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:21 user nova-compute[73007]: INFO oslo.privsep.daemon [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmph8lyqdet/privsep.sock']
Aug 15 17:43:21 user sudo[82382]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmph8lyqdet/privsep.sock
Aug 15 17:43:21 user sudo[82382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 17:43:21 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Successfully created port: 2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Successfully updated port: ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquired lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:22 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-9569ea9b-61fc-4bab-964a-691680778efb req-1b49c232-810b-4543-8a96-c78b36a6bf2e service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-changed-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-9569ea9b-61fc-4bab-964a-691680778efb req-1b49c232-810b-4543-8a96-c78b36a6bf2e service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Refreshing instance network info cache due to event network-changed-ddf68e4b-1015-4964-9b62-d41585fd04fc. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9569ea9b-61fc-4bab-964a-691680778efb req-1b49c232-810b-4543-8a96-c78b36a6bf2e service nova] Acquiring lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:22 user nova-compute[73007]: DEBUG nova.network.neutron [req-866fa963-91b0-460e-92ed-e0181b45e130 req-9fd17f5e-d1dc-4962-90c7-88521538ca39 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Updated VIF entry in instance network info cache for port 238f4b21-1dbe-4870-8282-cc0c11449862. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:22 user nova-compute[73007]: DEBUG nova.network.neutron [req-866fa963-91b0-460e-92ed-e0181b45e130 req-9fd17f5e-d1dc-4962-90c7-88521538ca39 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Updating instance_info_cache with network_info: [{"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-866fa963-91b0-460e-92ed-e0181b45e130 req-9fd17f5e-d1dc-4962-90c7-88521538ca39 service nova] Releasing lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:22 user sudo[82382]: pam_unix(sudo:session): session closed for user root
Aug 15 17:43:22 user nova-compute[73007]: INFO oslo.privsep.daemon [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Spawned new privsep daemon via rootwrap
Aug 15 17:43:22 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 17:43:22 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 17:43:22 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 17:43:22 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82386
Aug 15 17:43:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap238f4b21-1d, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap238f4b21-1d, col_values=(('external_ids', {'iface-id': '238f4b21-1dbe-4870-8282-cc0c11449862', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:3e:b4', 'vm-uuid': '1a098861-c387-4883-9d2c-e69ad9a7760a'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: INFO os_vif [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3e:b4,bridge_name='br-int',has_traffic_filtering=True,id=238f4b21-1dbe-4870-8282-cc0c11449862,network=Network(39470a92-679f-4036-b7f1-d4e220ec70da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f4b21-1d')
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] No VIF found with MAC fa:16:3e:91:3e:b4, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.neutron [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Successfully created port: 74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Releasing lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance network_info: |[{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9569ea9b-61fc-4bab-964a-691680778efb req-1b49c232-810b-4543-8a96-c78b36a6bf2e service nova] Acquired lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.neutron [req-9569ea9b-61fc-4bab-964a-691680778efb req-1b49c232-810b-4543-8a96-c78b36a6bf2e service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Refreshing network info cache for port ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Start _get_guest_xml network_info=[{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:23 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:23 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-808387531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-808387531',id=2,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiWEFDUTizVa6mi6X2e8otnDTG491szA8E97zyePRTalDLnNNs2ZAC8znJJ0grfy7VMp8BwtMHD/veSKaeDPORLqU4usx4qvYLND4S2EsVvZAWztlqq8rgYjlGoxNrIVQ==',key_name='tempest-keypair-21307621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-p93ff0q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=a82e6742-fe31-4693-8db5-50dc97f6072c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'pci_devices' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:23 user nova-compute[73007]:   <uuid>a82e6742-fe31-4693-8db5-50dc97f6072c</uuid>
Aug 15 17:43:23 user nova-compute[73007]:   <name>instance-00000002</name>
Aug 15 17:43:23 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:23 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:23 user nova-compute[73007]:   <metadata>
Aug 15 17:43:23 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:23 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:23 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-808387531</nova:name>
Aug 15 17:43:23 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:23</nova:creationTime>
Aug 15 17:43:23 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:23 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:23 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:23 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:23 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:23 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:23 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:23 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:23 user nova-compute[73007]:         <nova:user uuid="206f089e51fd4e8f842a5584b630c736">tempest-AttachVolumeShelveTestJSON-1726690631-project-member</nova:user>
Aug 15 17:43:23 user nova-compute[73007]:         <nova:project uuid="4727295cc556413eb5dd6ca0d10f50e7">tempest-AttachVolumeShelveTestJSON-1726690631</nova:project>
Aug 15 17:43:23 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:23 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:43:23 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:23 user nova-compute[73007]:         <nova:port uuid="ddf68e4b-1015-4964-9b62-d41585fd04fc">
Aug 15 17:43:23 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 17:43:23 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:23 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:23 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:23 user nova-compute[73007]:   </metadata>
Aug 15 17:43:23 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:23 user nova-compute[73007]:     <system>
Aug 15 17:43:23 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:23 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:23 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:23 user nova-compute[73007]:       <entry name="serial">a82e6742-fe31-4693-8db5-50dc97f6072c</entry>
Aug 15 17:43:23 user nova-compute[73007]:       <entry name="uuid">a82e6742-fe31-4693-8db5-50dc97f6072c</entry>
Aug 15 17:43:23 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:23 user nova-compute[73007]:     </system>
Aug 15 17:43:23 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:23 user nova-compute[73007]:   <os>
Aug 15 17:43:23 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:23 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:23 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:23 user nova-compute[73007]:   </os>
Aug 15 17:43:23 user nova-compute[73007]:   <features>
Aug 15 17:43:23 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:23 user nova-compute[73007]:     <apic/>
Aug 15 17:43:23 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:23 user nova-compute[73007]:   </features>
Aug 15 17:43:23 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:23 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:23 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:23 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:23 user nova-compute[73007]:   </clock>
Aug 15 17:43:23 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:23 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:23 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:23 user nova-compute[73007]:   </cpu>
Aug 15 17:43:23 user nova-compute[73007]:   <devices>
Aug 15 17:43:23 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:23 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:23 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk"/>
Aug 15 17:43:23 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:43:23 user nova-compute[73007]:     </disk>
Aug 15 17:43:23 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:23 user nova-compute[73007]:       <mac address="fa:16:3e:2e:2c:d6"/>
Aug 15 17:43:23 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:23 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:23 user nova-compute[73007]:       <target dev="tapddf68e4b-10"/>
Aug 15 17:43:23 user nova-compute[73007]:     </interface>
Aug 15 17:43:23 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:23 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/console.log" append="off"/>
Aug 15 17:43:23 user nova-compute[73007]:     </serial>
Aug 15 17:43:23 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:23 user nova-compute[73007]:     <video>
Aug 15 17:43:23 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:23 user nova-compute[73007]:     </video>
Aug 15 17:43:23 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:23 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:23 user nova-compute[73007]:     </rng>
Aug 15 17:43:23 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:23 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:23 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:23 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:23 user nova-compute[73007]:   </devices>
Aug 15 17:43:23 user nova-compute[73007]: </domain>
Aug 15 17:43:23 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-808387531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-808387531',id=2,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiWEFDUTizVa6mi6X2e8otnDTG491szA8E97zyePRTalDLnNNs2ZAC8znJJ0grfy7VMp8BwtMHD/veSKaeDPORLqU4usx4qvYLND4S2EsVvZAWztlqq8rgYjlGoxNrIVQ==',key_name='tempest-keypair-21307621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-p93ff0q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=a82e6742-fe31-4693-8db5-50dc97f6072c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG os_vif [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddf68e4b-10, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapddf68e4b-10, col_values=(('external_ids', {'iface-id': 'ddf68e4b-1015-4964-9b62-d41585fd04fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:2c:d6', 'vm-uuid': 'a82e6742-fe31-4693-8db5-50dc97f6072c'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: INFO os_vif [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10')
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No VIF found with MAC fa:16:3e:2e:2c:d6, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.neutron [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Successfully updated port: 4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquired lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:23 user nova-compute[73007]: DEBUG nova.network.neutron [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Successfully updated port: 2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquired lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-d7ebe7fc-bb71-4f9a-9b02-69ab0516f13a req-87d7e010-0a4d-40ed-8dd3-f982a8d03545 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received event network-changed-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-d7ebe7fc-bb71-4f9a-9b02-69ab0516f13a req-87d7e010-0a4d-40ed-8dd3-f982a8d03545 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Refreshing instance network info cache due to event network-changed-4ca037da-7acd-4a45-a808-6a655ae3416b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d7ebe7fc-bb71-4f9a-9b02-69ab0516f13a req-87d7e010-0a4d-40ed-8dd3-f982a8d03545 service nova] Acquiring lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updating instance_info_cache with network_info: [{"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Releasing lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Instance network_info: |[{"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d7ebe7fc-bb71-4f9a-9b02-69ab0516f13a req-87d7e010-0a4d-40ed-8dd3-f982a8d03545 service nova] Acquired lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.neutron [req-d7ebe7fc-bb71-4f9a-9b02-69ab0516f13a req-87d7e010-0a4d-40ed-8dd3-f982a8d03545 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Refreshing network info cache for port 4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Start _get_guest_xml network_info=[{"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:24 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:24 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1294098274',display_name='tempest-AttachVolumeNegativeTest-server-1294098274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1294098274',id=3,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3Wmk5+4774bMab8WvB8/6GJhJd0I3p/XB5qhbR8dTT04lIBgObnm5Xq+favpCg3Gq+g0YxPWesNt1cgLYWkVbKXgYtE8p4n1COfLcmsXHzN6wTJQHLI7MBRYIHfaRW+w==',key_name='tempest-keypair-1417654794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-htlezkf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=fd108aa2-dd29-41ed-9deb-41bc3d08c1e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:6d:12,bridge_name='br-int',has_traffic_filtering=True,id=4ca037da-7acd-4a45-a808-6a655ae3416b,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca037da-7a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'pci_devices' on Instance uuid fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:24 user nova-compute[73007]:   <uuid>fd108aa2-dd29-41ed-9deb-41bc3d08c1e2</uuid>
Aug 15 17:43:24 user nova-compute[73007]:   <name>instance-00000003</name>
Aug 15 17:43:24 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:24 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:24 user nova-compute[73007]:   <metadata>
Aug 15 17:43:24 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:24 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1294098274</nova:name>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:24</nova:creationTime>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:24 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:24 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:user uuid="82906484a46f4ad0be9a602aec2affb6">tempest-AttachVolumeNegativeTest-1698859108-project-member</nova:user>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:project uuid="1bfa702dd2884da4b28a84db913819b6">tempest-AttachVolumeNegativeTest-1698859108</nova:project>
Aug 15 17:43:24 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:port uuid="4ca037da-7acd-4a45-a808-6a655ae3416b">
Aug 15 17:43:24 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 17:43:24 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:24 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:24 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:24 user nova-compute[73007]:   </metadata>
Aug 15 17:43:24 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:24 user nova-compute[73007]:     <system>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="serial">fd108aa2-dd29-41ed-9deb-41bc3d08c1e2</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="uuid">fd108aa2-dd29-41ed-9deb-41bc3d08c1e2</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:24 user nova-compute[73007]:     </system>
Aug 15 17:43:24 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:24 user nova-compute[73007]:   <os>
Aug 15 17:43:24 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:24 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:24 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:24 user nova-compute[73007]:   </os>
Aug 15 17:43:24 user nova-compute[73007]:   <features>
Aug 15 17:43:24 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:24 user nova-compute[73007]:     <apic/>
Aug 15 17:43:24 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:24 user nova-compute[73007]:   </features>
Aug 15 17:43:24 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:24 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:24 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:24 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:24 user nova-compute[73007]:   </clock>
Aug 15 17:43:24 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:24 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:24 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:24 user nova-compute[73007]:   </cpu>
Aug 15 17:43:24 user nova-compute[73007]:   <devices>
Aug 15 17:43:24 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:24 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:24 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk"/>
Aug 15 17:43:24 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:43:24 user nova-compute[73007]:     </disk>
Aug 15 17:43:24 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:24 user nova-compute[73007]:       <mac address="fa:16:3e:54:6d:12"/>
Aug 15 17:43:24 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:24 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:24 user nova-compute[73007]:       <target dev="tap4ca037da-7a"/>
Aug 15 17:43:24 user nova-compute[73007]:     </interface>
Aug 15 17:43:24 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:24 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/console.log" append="off"/>
Aug 15 17:43:24 user nova-compute[73007]:     </serial>
Aug 15 17:43:24 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:24 user nova-compute[73007]:     <video>
Aug 15 17:43:24 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:24 user nova-compute[73007]:     </video>
Aug 15 17:43:24 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:24 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:24 user nova-compute[73007]:     </rng>
Aug 15 17:43:24 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:24 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:24 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:24 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:24 user nova-compute[73007]:   </devices>
Aug 15 17:43:24 user nova-compute[73007]: </domain>
Aug 15 17:43:24 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1294098274',display_name='tempest-AttachVolumeNegativeTest-server-1294098274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1294098274',id=3,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3Wmk5+4774bMab8WvB8/6GJhJd0I3p/XB5qhbR8dTT04lIBgObnm5Xq+favpCg3Gq+g0YxPWesNt1cgLYWkVbKXgYtE8p4n1COfLcmsXHzN6wTJQHLI7MBRYIHfaRW+w==',key_name='tempest-keypair-1417654794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-htlezkf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=fd108aa2-dd29-41ed-9deb-41bc3d08c1e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:6d:12,bridge_name='br-int',has_traffic_filtering=True,id=4ca037da-7acd-4a45-a808-6a655ae3416b,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca037da-7a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG os_vif [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:6d:12,bridge_name='br-int',has_traffic_filtering=True,id=4ca037da-7acd-4a45-a808-6a655ae3416b,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca037da-7a') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ca037da-7a, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ca037da-7a, col_values=(('external_ids', {'iface-id': '4ca037da-7acd-4a45-a808-6a655ae3416b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:6d:12', 'vm-uuid': 'fd108aa2-dd29-41ed-9deb-41bc3d08c1e2'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:24 user nova-compute[73007]: INFO os_vif [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:6d:12,bridge_name='br-int',has_traffic_filtering=True,id=4ca037da-7acd-4a45-a808-6a655ae3416b,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca037da-7a')
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No VIF found with MAC fa:16:3e:54:6d:12, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Releasing lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance network_info: |[{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Start _get_guest_xml network_info=[{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:24 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:24 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'pci_devices' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:24 user nova-compute[73007]:   <uuid>42c38120-5e1d-4438-a53b-8a188e417c91</uuid>
Aug 15 17:43:24 user nova-compute[73007]:   <name>instance-00000004</name>
Aug 15 17:43:24 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:24 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:24 user nova-compute[73007]:   <metadata>
Aug 15 17:43:24 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:24 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeTestJSON-server-1553936509</nova:name>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:24</nova:creationTime>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:24 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:24 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:user uuid="1395246c93fc4c0dac8d95fffefd9711">tempest-AttachVolumeTestJSON-1742996205-project-member</nova:user>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:project uuid="e1deb9da1fb54f8b8968f01265347c48">tempest-AttachVolumeTestJSON-1742996205</nova:project>
Aug 15 17:43:24 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:43:24 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:24 user nova-compute[73007]:         <nova:port uuid="2c926c8a-890e-40cf-b2c4-906f890e4791">
Aug 15 17:43:24 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 17:43:24 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:24 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:24 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:24 user nova-compute[73007]:   </metadata>
Aug 15 17:43:24 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:24 user nova-compute[73007]:     <system>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="serial">42c38120-5e1d-4438-a53b-8a188e417c91</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="uuid">42c38120-5e1d-4438-a53b-8a188e417c91</entry>
Aug 15 17:43:24 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:24 user nova-compute[73007]:     </system>
Aug 15 17:43:24 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:24 user nova-compute[73007]:   <os>
Aug 15 17:43:24 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:24 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:24 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:24 user nova-compute[73007]:   </os>
Aug 15 17:43:24 user nova-compute[73007]:   <features>
Aug 15 17:43:24 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:24 user nova-compute[73007]:     <apic/>
Aug 15 17:43:24 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:24 user nova-compute[73007]:   </features>
Aug 15 17:43:24 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:24 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:24 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:24 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:24 user nova-compute[73007]:   </clock>
Aug 15 17:43:24 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:24 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:24 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:24 user nova-compute[73007]:   </cpu>
Aug 15 17:43:24 user nova-compute[73007]:   <devices>
Aug 15 17:43:24 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:24 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:24 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk"/>
Aug 15 17:43:24 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:43:24 user nova-compute[73007]:     </disk>
Aug 15 17:43:24 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:24 user nova-compute[73007]:       <mac address="fa:16:3e:4c:f4:0a"/>
Aug 15 17:43:24 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:24 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:24 user nova-compute[73007]:       <target dev="tap2c926c8a-89"/>
Aug 15 17:43:24 user nova-compute[73007]:     </interface>
Aug 15 17:43:24 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:24 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/console.log" append="off"/>
Aug 15 17:43:24 user nova-compute[73007]:     </serial>
Aug 15 17:43:24 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:24 user nova-compute[73007]:     <video>
Aug 15 17:43:24 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:24 user nova-compute[73007]:     </video>
Aug 15 17:43:24 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:24 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:24 user nova-compute[73007]:     </rng>
Aug 15 17:43:24 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:24 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:24 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:24 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:24 user nova-compute[73007]:   </devices>
Aug 15 17:43:24 user nova-compute[73007]: </domain>
Aug 15 17:43:24 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG os_vif [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c926c8a-89, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c926c8a-89, col_values=(('external_ids', {'iface-id': '2c926c8a-890e-40cf-b2c4-906f890e4791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:f4:0a', 'vm-uuid': '42c38120-5e1d-4438-a53b-8a188e417c91'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:24 user nova-compute[73007]: INFO os_vif [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89')
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No VIF found with MAC fa:16:3e:4c:f4:0a, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-d7ebe7fc-bb71-4f9a-9b02-69ab0516f13a req-87d7e010-0a4d-40ed-8dd3-f982a8d03545 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updated VIF entry in instance network info cache for port 4ca037da-7acd-4a45-a808-6a655ae3416b. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-d7ebe7fc-bb71-4f9a-9b02-69ab0516f13a req-87d7e010-0a4d-40ed-8dd3-f982a8d03545 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updating instance_info_cache with network_info: [{"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d7ebe7fc-bb71-4f9a-9b02-69ab0516f13a req-87d7e010-0a4d-40ed-8dd3-f982a8d03545 service nova] Releasing lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-9569ea9b-61fc-4bab-964a-691680778efb req-1b49c232-810b-4543-8a96-c78b36a6bf2e service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updated VIF entry in instance network info cache for port ddf68e4b-1015-4964-9b62-d41585fd04fc. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-9569ea9b-61fc-4bab-964a-691680778efb req-1b49c232-810b-4543-8a96-c78b36a6bf2e service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9569ea9b-61fc-4bab-964a-691680778efb req-1b49c232-810b-4543-8a96-c78b36a6bf2e service nova] Releasing lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-8ec01e61-bfbc-4bde-b241-dce3d89109af req-79a6fea3-bf73-4d19-81b9-4cc8ff5602d0 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-changed-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-8ec01e61-bfbc-4bde-b241-dce3d89109af req-79a6fea3-bf73-4d19-81b9-4cc8ff5602d0 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Refreshing instance network info cache due to event network-changed-2c926c8a-890e-40cf-b2c4-906f890e4791. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ec01e61-bfbc-4bde-b241-dce3d89109af req-79a6fea3-bf73-4d19-81b9-4cc8ff5602d0 service nova] Acquiring lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ec01e61-bfbc-4bde-b241-dce3d89109af req-79a6fea3-bf73-4d19-81b9-4cc8ff5602d0 service nova] Acquired lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:26 user nova-compute[73007]: DEBUG nova.network.neutron [req-8ec01e61-bfbc-4bde-b241-dce3d89109af req-79a6fea3-bf73-4d19-81b9-4cc8ff5602d0 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Refreshing network info cache for port 2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG nova.network.neutron [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Successfully updated port: 74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquired lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG nova.network.neutron [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-ef45a266-93ab-46be-8dda-46080c72bc37 req-76e36f81-cfdd-4eba-8c22-aebe0d5b89a4 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-changed-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-ef45a266-93ab-46be-8dda-46080c72bc37 req-76e36f81-cfdd-4eba-8c22-aebe0d5b89a4 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Refreshing instance network info cache due to event network-changed-74017a60-7a29-446b-9f9d-d26f80ddbba6. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ef45a266-93ab-46be-8dda-46080c72bc37 req-76e36f81-cfdd-4eba-8c22-aebe0d5b89a4 service nova] Acquiring lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-8ec01e61-bfbc-4bde-b241-dce3d89109af req-79a6fea3-bf73-4d19-81b9-4cc8ff5602d0 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updated VIF entry in instance network info cache for port 2c926c8a-890e-40cf-b2c4-906f890e4791. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-8ec01e61-bfbc-4bde-b241-dce3d89109af req-79a6fea3-bf73-4d19-81b9-4cc8ff5602d0 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ec01e61-bfbc-4bde-b241-dce3d89109af req-79a6fea3-bf73-4d19-81b9-4cc8ff5602d0 service nova] Releasing lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:29 user nova-compute[73007]: INFO nova.compute.claims [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Claim successful on node user
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.network.neutron [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Releasing lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance network_info: |[{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ef45a266-93ab-46be-8dda-46080c72bc37 req-76e36f81-cfdd-4eba-8c22-aebe0d5b89a4 service nova] Acquired lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-ef45a266-93ab-46be-8dda-46080c72bc37 req-76e36f81-cfdd-4eba-8c22-aebe0d5b89a4 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Refreshing network info cache for port 74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Start _get_guest_xml network_info=[{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:29 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:29 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1601217636',display_name='tempest-ServerStableDeviceRescueTest-server-1601217636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1601217636',id=5,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6fDWuzEVq/DVBeB7mtTRrD/fi2/SBj5rmbBPPs4B6BhnLzf8/8g05D7jlSdp2dfBdUytS4ffKyfoSx1xaRX9ixwki3Ieg4b39NYClkJRpH7USbFwcrreCMLTbEMzR+GQ==',key_name='tempest-keypair-929768774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097ecc4c5c86438b94fd930ca13f47dc',ramdisk_id='',reservation_id='r-yvriih0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-173917546',owner_user_name='tempest-ServerStableDeviceRescueTest-173917546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f13824fa664d9ca209ec7b4d826bdf',uuid=6b14b5d1-a493-4506-be76-029324a5aadd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Converting VIF {"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:52:73,bridge_name='br-int',has_traffic_filtering=True,id=74017a60-7a29-446b-9f9d-d26f80ddbba6,network=Network(6a895edd-4249-4372-8fe4-f76cd74491cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74017a60-7a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:29 user nova-compute[73007]:   <uuid>6b14b5d1-a493-4506-be76-029324a5aadd</uuid>
Aug 15 17:43:29 user nova-compute[73007]:   <name>instance-00000005</name>
Aug 15 17:43:29 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:29 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:29 user nova-compute[73007]:   <metadata>
Aug 15 17:43:29 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:29 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:29 user nova-compute[73007]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1601217636</nova:name>
Aug 15 17:43:29 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:29</nova:creationTime>
Aug 15 17:43:29 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:29 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:29 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:29 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:29 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:29 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:29 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:29 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:29 user nova-compute[73007]:         <nova:user uuid="f6f13824fa664d9ca209ec7b4d826bdf">tempest-ServerStableDeviceRescueTest-173917546-project-member</nova:user>
Aug 15 17:43:29 user nova-compute[73007]:         <nova:project uuid="097ecc4c5c86438b94fd930ca13f47dc">tempest-ServerStableDeviceRescueTest-173917546</nova:project>
Aug 15 17:43:29 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:29 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:43:29 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:29 user nova-compute[73007]:         <nova:port uuid="74017a60-7a29-446b-9f9d-d26f80ddbba6">
Aug 15 17:43:29 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 17:43:29 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:29 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:29 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:29 user nova-compute[73007]:   </metadata>
Aug 15 17:43:29 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:29 user nova-compute[73007]:     <system>
Aug 15 17:43:29 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:29 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:29 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:29 user nova-compute[73007]:       <entry name="serial">6b14b5d1-a493-4506-be76-029324a5aadd</entry>
Aug 15 17:43:29 user nova-compute[73007]:       <entry name="uuid">6b14b5d1-a493-4506-be76-029324a5aadd</entry>
Aug 15 17:43:29 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:29 user nova-compute[73007]:     </system>
Aug 15 17:43:29 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:29 user nova-compute[73007]:   <os>
Aug 15 17:43:29 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:29 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:29 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:29 user nova-compute[73007]:   </os>
Aug 15 17:43:29 user nova-compute[73007]:   <features>
Aug 15 17:43:29 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:29 user nova-compute[73007]:     <apic/>
Aug 15 17:43:29 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:29 user nova-compute[73007]:   </features>
Aug 15 17:43:29 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:29 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:29 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:29 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:29 user nova-compute[73007]:   </clock>
Aug 15 17:43:29 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:29 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:29 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:29 user nova-compute[73007]:   </cpu>
Aug 15 17:43:29 user nova-compute[73007]:   <devices>
Aug 15 17:43:29 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:29 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:29 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk"/>
Aug 15 17:43:29 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:43:29 user nova-compute[73007]:     </disk>
Aug 15 17:43:29 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:29 user nova-compute[73007]:       <mac address="fa:16:3e:13:52:73"/>
Aug 15 17:43:29 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:29 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:29 user nova-compute[73007]:       <target dev="tap74017a60-7a"/>
Aug 15 17:43:29 user nova-compute[73007]:     </interface>
Aug 15 17:43:29 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:29 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/console.log" append="off"/>
Aug 15 17:43:29 user nova-compute[73007]:     </serial>
Aug 15 17:43:29 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:29 user nova-compute[73007]:     <video>
Aug 15 17:43:29 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:29 user nova-compute[73007]:     </video>
Aug 15 17:43:29 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:29 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:29 user nova-compute[73007]:     </rng>
Aug 15 17:43:29 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:29 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:29 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:29 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:29 user nova-compute[73007]:   </devices>
Aug 15 17:43:29 user nova-compute[73007]: </domain>
Aug 15 17:43:29 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1601217636',display_name='tempest-ServerStableDeviceRescueTest-server-1601217636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1601217636',id=5,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6fDWuzEVq/DVBeB7mtTRrD/fi2/SBj5rmbBPPs4B6BhnLzf8/8g05D7jlSdp2dfBdUytS4ffKyfoSx1xaRX9ixwki3Ieg4b39NYClkJRpH7USbFwcrreCMLTbEMzR+GQ==',key_name='tempest-keypair-929768774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='097ecc4c5c86438b94fd930ca13f47dc',ramdisk_id='',reservation_id='r-yvriih0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-173917546',owner_user_name='tempest-ServerStableDeviceRescueTest-173917546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f13824fa664d9ca209ec7b4d826bdf',uuid=6b14b5d1-a493-4506-be76-029324a5aadd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Converting VIF {"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:52:73,bridge_name='br-int',has_traffic_filtering=True,id=74017a60-7a29-446b-9f9d-d26f80ddbba6,network=Network(6a895edd-4249-4372-8fe4-f76cd74491cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74017a60-7a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG os_vif [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:52:73,bridge_name='br-int',has_traffic_filtering=True,id=74017a60-7a29-446b-9f9d-d26f80ddbba6,network=Network(6a895edd-4249-4372-8fe4-f76cd74491cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74017a60-7a') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74017a60-7a, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74017a60-7a, col_values=(('external_ids', {'iface-id': '74017a60-7a29-446b-9f9d-d26f80ddbba6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:52:73', 'vm-uuid': '6b14b5d1-a493-4506-be76-029324a5aadd'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:29 user nova-compute[73007]: INFO os_vif [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:52:73,bridge_name='br-int',has_traffic_filtering=True,id=74017a60-7a29-446b-9f9d-d26f80ddbba6,network=Network(6a895edd-4249-4372-8fe4-f76cd74491cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74017a60-7a')
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No VIF found with MAC fa:16:3e:13:52:73, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.network.neutron [req-ef45a266-93ab-46be-8dda-46080c72bc37 req-76e36f81-cfdd-4eba-8c22-aebe0d5b89a4 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updated VIF entry in instance network info cache for port 74017a60-7a29-446b-9f9d-d26f80ddbba6. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.network.neutron [req-ef45a266-93ab-46be-8dda-46080c72bc37 req-76e36f81-cfdd-4eba-8c22-aebe0d5b89a4 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ef45a266-93ab-46be-8dda-46080c72bc37 req-76e36f81-cfdd-4eba-8c22-aebe0d5b89a4 service nova] Releasing lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121412.4318082, 1a098861-c387-4883-9d2c-e69ad9a7760a => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] VM Resumed (Lifecycle Event)
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Instance spawned successfully.
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance spawned successfully.
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.078s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121412.4325879, 1a098861-c387-4883-9d2c-e69ad9a7760a => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] VM Started (Lifecycle Event)
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Took 21.31 seconds to spawn the instance on the hypervisor.
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.compute.manager [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Took 22.29 seconds to build instance.
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121412.4433217, a82e6742-fe31-4693-8db5-50dc97f6072c => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] VM Resumed (Lifecycle Event)
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:32 user nova-compute[73007]: INFO nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Took 17.85 seconds to spawn the instance on the hypervisor.
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d9d8cbcd-51c0-44e1-871a-db530adf9306 tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.582s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121412.4438124, a82e6742-fe31-4693-8db5-50dc97f6072c => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] VM Started (Lifecycle Event)
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Took 18.64 seconds to build instance.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b13f0345-d318-4abb-8211-c205987177f5 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.806s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Creating image(s)
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "/opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "/opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "/opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121413.2615628, fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] VM Resumed (Lifecycle Event)
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Instance spawned successfully.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.policy [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22977501a17f4458bb5c8be69a2c26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40320dc41a5b47339fe34ded685fba41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121413.2619705, fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] VM Started (Lifecycle Event)
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.264s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Took 16.67 seconds to spawn the instance on the hypervisor.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121413.5889134, 42c38120-5e1d-4438-a53b-8a188e417c91 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Resumed (Lifecycle Event)
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance spawned successfully.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121413.5902057, 42c38120-5e1d-4438-a53b-8a188e417c91 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Started (Lifecycle Event)
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Took 17.53 seconds to build instance.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-82585efc-b87c-4481-abd3-20b2062f7f28 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.753s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.375s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:33 user nova-compute[73007]: INFO nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Took 16.72 seconds to spawn the instance on the hypervisor.
Aug 15 17:43:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk 1073741824" returned: 0 in 0.114s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.493s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121414.237867, 6b14b5d1-a493-4506-be76-029324a5aadd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:34 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] VM Resumed (Lifecycle Event)
Aug 15 17:43:34 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance spawned successfully.
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.359s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:34 user nova-compute[73007]: INFO nova.compute.manager [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Took 18.11 seconds to build instance.
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4afbe938-8cd5-4053-b41a-c89cc45e12e2 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.313s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:34 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121414.2381866, 6b14b5d1-a493-4506-be76-029324a5aadd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:34 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] VM Started (Lifecycle Event)
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:34 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.397s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Cannot resize image /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'migration_context' on Instance uuid 31637822-05e9-4762-b3b3-2bc6e49efb6e {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:34 user nova-compute[73007]: INFO nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Took 15.29 seconds to spawn the instance on the hypervisor.
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Ensure instance console log exists: /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:34 user nova-compute[73007]: INFO nova.compute.manager [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Took 16.15 seconds to build instance.
Aug 15 17:43:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6574edc2-0fae-490c-b80d-1a1a8504f490 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.274s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Successfully created port: ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:38 user nova-compute[73007]: INFO nova.compute.claims [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Claim successful on node user
Aug 15 17:43:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Successfully updated port: ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquired lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-851b1c59-2328-4a3a-8f29-567a15780273 req-25fa77dd-ac17-4b66-b57a-8fc0d9c3f2df service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received event network-changed-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-851b1c59-2328-4a3a-8f29-567a15780273 req-25fa77dd-ac17-4b66-b57a-8fc0d9c3f2df service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Refreshing instance network info cache due to event network-changed-ec54f1b8-2099-4439-99f9-ab21931a1530. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-851b1c59-2328-4a3a-8f29-567a15780273 req-25fa77dd-ac17-4b66-b57a-8fc0d9c3f2df service nova] Acquiring lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.732s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG nova.network.neutron [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:39 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:39 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Creating image(s)
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "/opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "/opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "/opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG nova.policy [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac1bbe9b65f04fbb834750e17f8ec56d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fbf863175ad4e7090b13d1092f9a815', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.287s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.283s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk 1073741824" returned: 0 in 0.077s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updating instance_info_cache with network_info: [{"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Releasing lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Instance network_info: |[{"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-851b1c59-2328-4a3a-8f29-567a15780273 req-25fa77dd-ac17-4b66-b57a-8fc0d9c3f2df service nova] Acquired lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.network.neutron [req-851b1c59-2328-4a3a-8f29-567a15780273 req-25fa77dd-ac17-4b66-b57a-8fc0d9c3f2df service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Refreshing network info cache for port ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Start _get_guest_xml network_info=[{"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:40 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:40 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1838184703',display_name='tempest-VolumesAdminNegativeTest-server-1838184703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1838184703',id=6,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxENEjxthbGmc9/sXbnMSZscrX0MH4V++IMNQj3X4tOwSnMQTOfsTv1eWw49+grpZ+T7owCrFN9OHjI/fcjHB5XqbcqSUZ8pyUvvza9quRlz2tOBNTUwDmodk4VP/frvQ==',key_name='tempest-keypair-1986916607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40320dc41a5b47339fe34ded685fba41',ramdisk_id='',reservation_id='r-8490wzrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2030731104',owner_user_name='tempest-VolumesAdminNegativeTest-2030731104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22977501a17f4458bb5c8be69a2c26b4',uuid=31637822-05e9-4762-b3b3-2bc6e49efb6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converting VIF {"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d9:bc,bridge_name='br-int',has_traffic_filtering=True,id=ec54f1b8-2099-4439-99f9-ab21931a1530,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec54f1b8-20') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'pci_devices' on Instance uuid 31637822-05e9-4762-b3b3-2bc6e49efb6e {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.356s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:40 user nova-compute[73007]:   <uuid>31637822-05e9-4762-b3b3-2bc6e49efb6e</uuid>
Aug 15 17:43:40 user nova-compute[73007]:   <name>instance-00000006</name>
Aug 15 17:43:40 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:40 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:40 user nova-compute[73007]:   <metadata>
Aug 15 17:43:40 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:40 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:40 user nova-compute[73007]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1838184703</nova:name>
Aug 15 17:43:40 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:40</nova:creationTime>
Aug 15 17:43:40 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:40 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:40 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:40 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:40 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:40 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:40 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:40 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:40 user nova-compute[73007]:         <nova:user uuid="22977501a17f4458bb5c8be69a2c26b4">tempest-VolumesAdminNegativeTest-2030731104-project-member</nova:user>
Aug 15 17:43:40 user nova-compute[73007]:         <nova:project uuid="40320dc41a5b47339fe34ded685fba41">tempest-VolumesAdminNegativeTest-2030731104</nova:project>
Aug 15 17:43:40 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:40 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:43:40 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:40 user nova-compute[73007]:         <nova:port uuid="ec54f1b8-2099-4439-99f9-ab21931a1530">
Aug 15 17:43:40 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 17:43:40 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:40 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:40 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:40 user nova-compute[73007]:   </metadata>
Aug 15 17:43:40 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:40 user nova-compute[73007]:     <system>
Aug 15 17:43:40 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:40 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:40 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:40 user nova-compute[73007]:       <entry name="serial">31637822-05e9-4762-b3b3-2bc6e49efb6e</entry>
Aug 15 17:43:40 user nova-compute[73007]:       <entry name="uuid">31637822-05e9-4762-b3b3-2bc6e49efb6e</entry>
Aug 15 17:43:40 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:40 user nova-compute[73007]:     </system>
Aug 15 17:43:40 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:40 user nova-compute[73007]:   <os>
Aug 15 17:43:40 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:40 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:40 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:40 user nova-compute[73007]:   </os>
Aug 15 17:43:40 user nova-compute[73007]:   <features>
Aug 15 17:43:40 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:40 user nova-compute[73007]:     <apic/>
Aug 15 17:43:40 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:40 user nova-compute[73007]:   </features>
Aug 15 17:43:40 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:40 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:40 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:40 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:40 user nova-compute[73007]:   </clock>
Aug 15 17:43:40 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:40 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:40 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:40 user nova-compute[73007]:   </cpu>
Aug 15 17:43:40 user nova-compute[73007]:   <devices>
Aug 15 17:43:40 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:40 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:40 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk"/>
Aug 15 17:43:40 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:43:40 user nova-compute[73007]:     </disk>
Aug 15 17:43:40 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:40 user nova-compute[73007]:       <mac address="fa:16:3e:8e:d9:bc"/>
Aug 15 17:43:40 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:40 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:40 user nova-compute[73007]:       <target dev="tapec54f1b8-20"/>
Aug 15 17:43:40 user nova-compute[73007]:     </interface>
Aug 15 17:43:40 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:40 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/console.log" append="off"/>
Aug 15 17:43:40 user nova-compute[73007]:     </serial>
Aug 15 17:43:40 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:40 user nova-compute[73007]:     <video>
Aug 15 17:43:40 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:40 user nova-compute[73007]:     </video>
Aug 15 17:43:40 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:40 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:40 user nova-compute[73007]:     </rng>
Aug 15 17:43:40 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:40 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:40 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:40 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:40 user nova-compute[73007]:   </devices>
Aug 15 17:43:40 user nova-compute[73007]: </domain>
Aug 15 17:43:40 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1838184703',display_name='tempest-VolumesAdminNegativeTest-server-1838184703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1838184703',id=6,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxENEjxthbGmc9/sXbnMSZscrX0MH4V++IMNQj3X4tOwSnMQTOfsTv1eWw49+grpZ+T7owCrFN9OHjI/fcjHB5XqbcqSUZ8pyUvvza9quRlz2tOBNTUwDmodk4VP/frvQ==',key_name='tempest-keypair-1986916607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40320dc41a5b47339fe34ded685fba41',ramdisk_id='',reservation_id='r-8490wzrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2030731104',owner_user_name='tempest-VolumesAdminNegativeTest-2030731104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22977501a17f4458bb5c8be69a2c26b4',uuid=31637822-05e9-4762-b3b3-2bc6e49efb6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converting VIF {"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d9:bc,bridge_name='br-int',has_traffic_filtering=True,id=ec54f1b8-2099-4439-99f9-ab21931a1530,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec54f1b8-20') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG os_vif [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d9:bc,bridge_name='br-int',has_traffic_filtering=True,id=ec54f1b8-2099-4439-99f9-ab21931a1530,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec54f1b8-20') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec54f1b8-20, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec54f1b8-20, col_values=(('external_ids', {'iface-id': 'ec54f1b8-2099-4439-99f9-ab21931a1530', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:d9:bc', 'vm-uuid': '31637822-05e9-4762-b3b3-2bc6e49efb6e'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:40 user nova-compute[73007]: INFO os_vif [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d9:bc,bridge_name='br-int',has_traffic_filtering=True,id=ec54f1b8-2099-4439-99f9-ab21931a1530,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec54f1b8-20')
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Cannot resize image /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.objects.instance [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lazy-loading 'migration_context' on Instance uuid 06651cc4-57ab-440f-8fb8-5be64b7441f3 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Ensure instance console log exists: /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] No VIF found with MAC fa:16:3e:8e:d9:bc, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-e0fae827-a012-41c0-93e3-8a9b4200e2a6 req-35d8ecf2-a8a1-49d7-9422-6fe2b7d6dd90 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received event network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e0fae827-a012-41c0-93e3-8a9b4200e2a6 req-35d8ecf2-a8a1-49d7-9422-6fe2b7d6dd90 service nova] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e0fae827-a012-41c0-93e3-8a9b4200e2a6 req-35d8ecf2-a8a1-49d7-9422-6fe2b7d6dd90 service nova] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e0fae827-a012-41c0-93e3-8a9b4200e2a6 req-35d8ecf2-a8a1-49d7-9422-6fe2b7d6dd90 service nova] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-e0fae827-a012-41c0-93e3-8a9b4200e2a6 req-35d8ecf2-a8a1-49d7-9422-6fe2b7d6dd90 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] No waiting events found dispatching network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:42 user nova-compute[73007]: WARNING nova.compute.manager [req-e0fae827-a012-41c0-93e3-8a9b4200e2a6 req-35d8ecf2-a8a1-49d7-9422-6fe2b7d6dd90 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received unexpected event network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 for instance with vm_state active and task_state None.
Aug 15 17:43:42 user nova-compute[73007]: DEBUG nova.network.neutron [req-851b1c59-2328-4a3a-8f29-567a15780273 req-25fa77dd-ac17-4b66-b57a-8fc0d9c3f2df service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updated VIF entry in instance network info cache for port ec54f1b8-2099-4439-99f9-ab21931a1530. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG nova.network.neutron [req-851b1c59-2328-4a3a-8f29-567a15780273 req-25fa77dd-ac17-4b66-b57a-8fc0d9c3f2df service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updating instance_info_cache with network_info: [{"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-851b1c59-2328-4a3a-8f29-567a15780273 req-25fa77dd-ac17-4b66-b57a-8fc0d9c3f2df service nova] Releasing lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG nova.network.neutron [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Successfully created port: 5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received event network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] No waiting events found dispatching network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:44 user nova-compute[73007]: WARNING nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received unexpected event network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 for instance with vm_state active and task_state None.
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received event network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] No waiting events found dispatching network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:44 user nova-compute[73007]: WARNING nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received unexpected event network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b for instance with vm_state active and task_state None.
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received event network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] No waiting events found dispatching network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:44 user nova-compute[73007]: WARNING nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received unexpected event network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b for instance with vm_state active and task_state None.
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:44 user nova-compute[73007]: WARNING nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state active and task_state None.
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:44 user nova-compute[73007]: WARNING nova.compute.manager [req-6ea65383-0276-43d3-b7e9-868d8b60ed9d req-cb9986c0-7d72-47d4-b554-da35c7f61dec service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state active and task_state None.
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.network.neutron [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Successfully updated port: 5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquired lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.network.neutron [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-71d64bea-e761-4b5f-ae15-bda65758226c req-de54d348-006a-44e3-a7c1-01eeea187333 service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received event network-changed-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-71d64bea-e761-4b5f-ae15-bda65758226c req-de54d348-006a-44e3-a7c1-01eeea187333 service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Refreshing instance network info cache due to event network-changed-5c1f8c7c-1c21-453a-a08a-632a7e16d01a. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-71d64bea-e761-4b5f-ae15-bda65758226c req-de54d348-006a-44e3-a7c1-01eeea187333 service nova] Acquiring lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.network.neutron [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.network.neutron [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Updating instance_info_cache with network_info: [{"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Releasing lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Instance network_info: |[{"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-71d64bea-e761-4b5f-ae15-bda65758226c req-de54d348-006a-44e3-a7c1-01eeea187333 service nova] Acquired lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.network.neutron [req-71d64bea-e761-4b5f-ae15-bda65758226c req-de54d348-006a-44e3-a7c1-01eeea187333 service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Refreshing network info cache for port 5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Start _get_guest_xml network_info=[{"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:45 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:45 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1204663676',display_name='tempest-VolumesAssistedSnapshotsTest-server-1204663676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1204663676',id=7,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzsG4jYXnvxuf6GCzRXgKiezsRYRKUQTsjbByKTRwbRda0MnzxstXWjYGKhKDy6kNDi5FrEw90g8smQWkeFrHgyjabrPrL30GZE54cKuKlRQnxdjh6Sz0kFw6Z+eIJARQ==',key_name='tempest-keypair-2091667164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fbf863175ad4e7090b13d1092f9a815',ramdisk_id='',reservation_id='r-ldvycod5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2009325632',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2009325632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac1bbe9b65f04fbb834750e17f8ec56d',uuid=06651cc4-57ab-440f-8fb8-5be64b7441f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Converting VIF {"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a6:a2,bridge_name='br-int',has_traffic_filtering=True,id=5c1f8c7c-1c21-453a-a08a-632a7e16d01a,network=Network(9cf4826a-d61a-4e74-b561-38b32967e497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1f8c7c-1c') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.objects.instance [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lazy-loading 'pci_devices' on Instance uuid 06651cc4-57ab-440f-8fb8-5be64b7441f3 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:45 user nova-compute[73007]:   <uuid>06651cc4-57ab-440f-8fb8-5be64b7441f3</uuid>
Aug 15 17:43:45 user nova-compute[73007]:   <name>instance-00000007</name>
Aug 15 17:43:45 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:45 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:45 user nova-compute[73007]:   <metadata>
Aug 15 17:43:45 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:45 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:45 user nova-compute[73007]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1204663676</nova:name>
Aug 15 17:43:45 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:45</nova:creationTime>
Aug 15 17:43:45 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:45 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:45 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:45 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:45 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:45 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:45 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:45 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:45 user nova-compute[73007]:         <nova:user uuid="ac1bbe9b65f04fbb834750e17f8ec56d">tempest-VolumesAssistedSnapshotsTest-2009325632-project-member</nova:user>
Aug 15 17:43:45 user nova-compute[73007]:         <nova:project uuid="8fbf863175ad4e7090b13d1092f9a815">tempest-VolumesAssistedSnapshotsTest-2009325632</nova:project>
Aug 15 17:43:45 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:45 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:43:45 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:45 user nova-compute[73007]:         <nova:port uuid="5c1f8c7c-1c21-453a-a08a-632a7e16d01a">
Aug 15 17:43:45 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:43:45 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:45 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:45 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:45 user nova-compute[73007]:   </metadata>
Aug 15 17:43:45 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:45 user nova-compute[73007]:     <system>
Aug 15 17:43:45 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:45 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:45 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:45 user nova-compute[73007]:       <entry name="serial">06651cc4-57ab-440f-8fb8-5be64b7441f3</entry>
Aug 15 17:43:45 user nova-compute[73007]:       <entry name="uuid">06651cc4-57ab-440f-8fb8-5be64b7441f3</entry>
Aug 15 17:43:45 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:45 user nova-compute[73007]:     </system>
Aug 15 17:43:45 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:45 user nova-compute[73007]:   <os>
Aug 15 17:43:45 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:45 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:45 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:45 user nova-compute[73007]:   </os>
Aug 15 17:43:45 user nova-compute[73007]:   <features>
Aug 15 17:43:45 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:45 user nova-compute[73007]:     <apic/>
Aug 15 17:43:45 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:45 user nova-compute[73007]:   </features>
Aug 15 17:43:45 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:45 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:45 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:45 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:45 user nova-compute[73007]:   </clock>
Aug 15 17:43:45 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:45 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:45 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:45 user nova-compute[73007]:   </cpu>
Aug 15 17:43:45 user nova-compute[73007]:   <devices>
Aug 15 17:43:45 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:45 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:45 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk"/>
Aug 15 17:43:45 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:43:45 user nova-compute[73007]:     </disk>
Aug 15 17:43:45 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:45 user nova-compute[73007]:       <mac address="fa:16:3e:1b:a6:a2"/>
Aug 15 17:43:45 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:45 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:45 user nova-compute[73007]:       <target dev="tap5c1f8c7c-1c"/>
Aug 15 17:43:45 user nova-compute[73007]:     </interface>
Aug 15 17:43:45 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:45 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/console.log" append="off"/>
Aug 15 17:43:45 user nova-compute[73007]:     </serial>
Aug 15 17:43:45 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:45 user nova-compute[73007]:     <video>
Aug 15 17:43:45 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:45 user nova-compute[73007]:     </video>
Aug 15 17:43:45 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:45 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:45 user nova-compute[73007]:     </rng>
Aug 15 17:43:45 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:45 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:45 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:45 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:45 user nova-compute[73007]:   </devices>
Aug 15 17:43:45 user nova-compute[73007]: </domain>
Aug 15 17:43:45 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1204663676',display_name='tempest-VolumesAssistedSnapshotsTest-server-1204663676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1204663676',id=7,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzsG4jYXnvxuf6GCzRXgKiezsRYRKUQTsjbByKTRwbRda0MnzxstXWjYGKhKDy6kNDi5FrEw90g8smQWkeFrHgyjabrPrL30GZE54cKuKlRQnxdjh6Sz0kFw6Z+eIJARQ==',key_name='tempest-keypair-2091667164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fbf863175ad4e7090b13d1092f9a815',ramdisk_id='',reservation_id='r-ldvycod5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2009325632',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2009325632-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac1bbe9b65f04fbb834750e17f8ec56d',uuid=06651cc4-57ab-440f-8fb8-5be64b7441f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Converting VIF {"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a6:a2,bridge_name='br-int',has_traffic_filtering=True,id=5c1f8c7c-1c21-453a-a08a-632a7e16d01a,network=Network(9cf4826a-d61a-4e74-b561-38b32967e497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1f8c7c-1c') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG os_vif [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a6:a2,bridge_name='br-int',has_traffic_filtering=True,id=5c1f8c7c-1c21-453a-a08a-632a7e16d01a,network=Network(9cf4826a-d61a-4e74-b561-38b32967e497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1f8c7c-1c') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c1f8c7c-1c, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c1f8c7c-1c, col_values=(('external_ids', {'iface-id': '5c1f8c7c-1c21-453a-a08a-632a7e16d01a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:a6:a2', 'vm-uuid': '06651cc4-57ab-440f-8fb8-5be64b7441f3'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:45 user nova-compute[73007]: INFO os_vif [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a6:a2,bridge_name='br-int',has_traffic_filtering=True,id=5c1f8c7c-1c21-453a-a08a-632a7e16d01a,network=Network(9cf4826a-d61a-4e74-b561-38b32967e497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1f8c7c-1c')
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] No VIF found with MAC fa:16:3e:1b:a6:a2, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121425.8757238, 31637822-05e9-4762-b3b3-2bc6e49efb6e => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:45 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] VM Resumed (Lifecycle Event)
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:43:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Instance spawned successfully.
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:46 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:46 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121425.8777416, 31637822-05e9-4762-b3b3-2bc6e49efb6e => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:46 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] VM Started (Lifecycle Event)
Aug 15 17:43:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:46 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:46 user nova-compute[73007]: INFO nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Took 12.99 seconds to spawn the instance on the hypervisor.
Aug 15 17:43:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:46 user nova-compute[73007]: INFO nova.compute.manager [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Took 16.93 seconds to build instance.
Aug 15 17:43:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c1084ae8-218d-4ed6-b5e5-8406ec64fd7f tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.071s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:46 user nova-compute[73007]: DEBUG nova.network.neutron [req-71d64bea-e761-4b5f-ae15-bda65758226c req-de54d348-006a-44e3-a7c1-01eeea187333 service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Updated VIF entry in instance network info cache for port 5c1f8c7c-1c21-453a-a08a-632a7e16d01a. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:46 user nova-compute[73007]: DEBUG nova.network.neutron [req-71d64bea-e761-4b5f-ae15-bda65758226c req-de54d348-006a-44e3-a7c1-01eeea187333 service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Updating instance_info_cache with network_info: [{"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-71d64bea-e761-4b5f-ae15-bda65758226c req-de54d348-006a-44e3-a7c1-01eeea187333 service nova] Releasing lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:48 user nova-compute[73007]: INFO nova.compute.claims [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Claim successful on node user
Aug 15 17:43:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:48 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.916s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:49 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:49 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Creating image(s)
Aug 15 17:43:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "/opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "/opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "/opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "085e269c222b44a107b428bccfe5c467648c3148" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "085e269c222b44a107b428bccfe5c467648c3148" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.policy [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1927ba78a2e84bb7b1ba8c3187a62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee903cb4cf54edbb46d3d735dd5ee4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-51b7ed72-f6fd-43e7-9627-7508118eaa59 req-c496e5e0-3e2b-4ed2-bb21-b3ccca79979e service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received event network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51b7ed72-f6fd-43e7-9627-7508118eaa59 req-c496e5e0-3e2b-4ed2-bb21-b3ccca79979e service nova] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51b7ed72-f6fd-43e7-9627-7508118eaa59 req-c496e5e0-3e2b-4ed2-bb21-b3ccca79979e service nova] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51b7ed72-f6fd-43e7-9627-7508118eaa59 req-c496e5e0-3e2b-4ed2-bb21-b3ccca79979e service nova] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-51b7ed72-f6fd-43e7-9627-7508118eaa59 req-c496e5e0-3e2b-4ed2-bb21-b3ccca79979e service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] No waiting events found dispatching network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:50 user nova-compute[73007]: WARNING nova.compute.manager [req-51b7ed72-f6fd-43e7-9627-7508118eaa59 req-c496e5e0-3e2b-4ed2-bb21-b3ccca79979e service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received unexpected event network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 for instance with vm_state active and task_state None.
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148.part --force-share --output=json" returned: 0 in 0.260s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.images [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9 was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148.part /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121430.4948485, 06651cc4-57ab-440f-8fb8-5be64b7441f3 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:50 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] VM Resumed (Lifecycle Event)
Aug 15 17:43:50 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Instance spawned successfully.
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:50 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121430.4953625, 06651cc4-57ab-440f-8fb8-5be64b7441f3 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:43:50 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] VM Started (Lifecycle Event)
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148.part /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148.converted" returned: 0 in 0.428s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-5b270e28-b94c-4c21-b102-8a93ebfd3fac req-65943235-418a-4808-82db-51bc80d0e085 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5b270e28-b94c-4c21-b102-8a93ebfd3fac req-65943235-418a-4808-82db-51bc80d0e085 service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5b270e28-b94c-4c21-b102-8a93ebfd3fac req-65943235-418a-4808-82db-51bc80d0e085 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5b270e28-b94c-4c21-b102-8a93ebfd3fac req-65943235-418a-4808-82db-51bc80d0e085 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-5b270e28-b94c-4c21-b102-8a93ebfd3fac req-65943235-418a-4808-82db-51bc80d0e085 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:50 user nova-compute[73007]: WARNING nova.compute.manager [req-5b270e28-b94c-4c21-b102-8a93ebfd3fac req-65943235-418a-4808-82db-51bc80d0e085 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state active and task_state None.
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:43:51 user nova-compute[73007]: INFO nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Took 11.62 seconds to spawn the instance on the hypervisor.
Aug 15 17:43:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:43:51 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "085e269c222b44a107b428bccfe5c467648c3148" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.726s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:51 user nova-compute[73007]: INFO nova.compute.manager [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Took 13.29 seconds to build instance.
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148 --force-share --output=json" returned: 0 in 0.348s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "085e269c222b44a107b428bccfe5c467648c3148" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "085e269c222b44a107b428bccfe5c467648c3148" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-003410a5-0da4-479c-858e-3ffb7690d9a1 tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.572s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148 --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148,backing_fmt=raw /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148,backing_fmt=raw /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk 1073741824" returned: 0 in 0.061s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "085e269c222b44a107b428bccfe5c467648c3148" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Successfully created port: b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-ead5bd58-bd27-4b88-96bd-eacf7f1f6971 req-0b2cb19d-5372-4094-ad0a-e56e9111435b service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received event network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ead5bd58-bd27-4b88-96bd-eacf7f1f6971 req-0b2cb19d-5372-4094-ad0a-e56e9111435b service nova] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ead5bd58-bd27-4b88-96bd-eacf7f1f6971 req-0b2cb19d-5372-4094-ad0a-e56e9111435b service nova] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ead5bd58-bd27-4b88-96bd-eacf7f1f6971 req-0b2cb19d-5372-4094-ad0a-e56e9111435b service nova] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-ead5bd58-bd27-4b88-96bd-eacf7f1f6971 req-0b2cb19d-5372-4094-ad0a-e56e9111435b service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] No waiting events found dispatching network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:51 user nova-compute[73007]: WARNING nova.compute.manager [req-ead5bd58-bd27-4b88-96bd-eacf7f1f6971 req-0b2cb19d-5372-4094-ad0a-e56e9111435b service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received unexpected event network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 for instance with vm_state active and task_state None.
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:43:51 user nova-compute[73007]: INFO nova.compute.claims [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Claim successful on node user
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148 --force-share --output=json" returned: 0 in 0.242s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Cannot resize image /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lazy-loading 'migration_context' on Instance uuid c456a6f0-d0d4-4927-85c9-2db4fde3c96f {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Ensure instance console log exists: /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:43:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-3fb08e84-2ad7-4ecc-b6c4-e7f08031a753 req-bb7cf5f8-dc81-4999-b9b6-b317f381562b service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3fb08e84-2ad7-4ecc-b6c4-e7f08031a753 req-bb7cf5f8-dc81-4999-b9b6-b317f381562b service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3fb08e84-2ad7-4ecc-b6c4-e7f08031a753 req-bb7cf5f8-dc81-4999-b9b6-b317f381562b service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3fb08e84-2ad7-4ecc-b6c4-e7f08031a753 req-bb7cf5f8-dc81-4999-b9b6-b317f381562b service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-3fb08e84-2ad7-4ecc-b6c4-e7f08031a753 req-bb7cf5f8-dc81-4999-b9b6-b317f381562b service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:52 user nova-compute[73007]: WARNING nova.compute.manager [req-3fb08e84-2ad7-4ecc-b6c4-e7f08031a753 req-bb7cf5f8-dc81-4999-b9b6-b317f381562b service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state active and task_state None.
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:43:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Creating image(s)
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "/opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "/opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "/opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.policy [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23832aa9aff9406b916174bcbdb8ed25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba216cdf4d404ba3b546cf6448c2021c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Successfully updated port: b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquired lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-5bebdd62-6561-4fd5-bbd0-eeabb9763c13 req-27f201db-9d17-4e37-bbb5-b745224e0eb2 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received event network-changed-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-5bebdd62-6561-4fd5-bbd0-eeabb9763c13 req-27f201db-9d17-4e37-bbb5-b745224e0eb2 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Refreshing instance network info cache due to event network-changed-b2809250-71fc-4b44-a58d-ef662a0bc079. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5bebdd62-6561-4fd5-bbd0-eeabb9763c13 req-27f201db-9d17-4e37-bbb5-b745224e0eb2 service nova] Acquiring lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.203s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk 1073741824" returned: 0 in 0.061s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Cannot resize image /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lazy-loading 'migration_context' on Instance uuid 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Ensure instance console log exists: /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Updating instance_info_cache with network_info: [{"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Releasing lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Instance network_info: |[{"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Skipping network cache update for instance because it is Building. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Skipping network cache update for instance because it is Building. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5bebdd62-6561-4fd5-bbd0-eeabb9763c13 req-27f201db-9d17-4e37-bbb5-b745224e0eb2 service nova] Acquired lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.network.neutron [req-5bebdd62-6561-4fd5-bbd0-eeabb9763c13 req-27f201db-9d17-4e37-bbb5-b745224e0eb2 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Refreshing network info cache for port b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Start _get_guest_xml network_info=[{"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:43:37Z,direct_url=<?>,disk_format='qcow2',id=f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9,min_disk=0,min_ram=0,name='',owner='860e873b2ad441b7a36a07c9a205f6e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:43:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/sda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'encryption_format': None, 'image_id': 'f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:43:37Z,direct_url=<?>,disk_format='qcow2',id=f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9,min_disk=0,min_ram=0,name='',owner='860e873b2ad441b7a36a07c9a205f6e6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:43:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-457650173',display_name='tempest-AttachSCSIVolumeTestJSON-server-457650173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-457650173',id=8,image_ref='f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9RJNNfL92NnvPAWf7kIStSh88iL8gfd+K2qEYGeG4qSyV+yzqOCD1yRmiFtcHFa4RJMwVVFPpPlImVs93l9XbhCbXeSNV4qSoFEIC8g4jGrjHvcSnV8mTgFA1Hp9OS1Q==',key_name='tempest-keypair-1140898119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee903cb4cf54edbb46d3d735dd5ee4f',ramdisk_id='',reservation_id='r-atad7kru',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-776031099',owner_user_name='tempest-AttachSCSIVolumeTestJSON-776031099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1927ba78a2e84bb7b1ba8c3187a62eac',uuid=c456a6f0-d0d4-4927-85c9-2db4fde3c96f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Converting VIF {"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ff:2a,bridge_name='br-int',has_traffic_filtering=True,id=b2809250-71fc-4b44-a58d-ef662a0bc079,network=Network(0679cb29-1994-47c8-97ea-589eeadfc21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2809250-71') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lazy-loading 'pci_devices' on Instance uuid c456a6f0-d0d4-4927-85c9-2db4fde3c96f {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:54 user nova-compute[73007]:   <uuid>c456a6f0-d0d4-4927-85c9-2db4fde3c96f</uuid>
Aug 15 17:43:54 user nova-compute[73007]:   <name>instance-00000008</name>
Aug 15 17:43:54 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:54 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:54 user nova-compute[73007]:   <metadata>
Aug 15 17:43:54 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:54 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:54 user nova-compute[73007]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-457650173</nova:name>
Aug 15 17:43:54 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:54</nova:creationTime>
Aug 15 17:43:54 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:54 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:54 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:54 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:54 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:54 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:54 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:54 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:54 user nova-compute[73007]:         <nova:user uuid="1927ba78a2e84bb7b1ba8c3187a62eac">tempest-AttachSCSIVolumeTestJSON-776031099-project-member</nova:user>
Aug 15 17:43:54 user nova-compute[73007]:         <nova:project uuid="0ee903cb4cf54edbb46d3d735dd5ee4f">tempest-AttachSCSIVolumeTestJSON-776031099</nova:project>
Aug 15 17:43:54 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:54 user nova-compute[73007]:       <nova:root type="image" uuid="f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9"/>
Aug 15 17:43:54 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:54 user nova-compute[73007]:         <nova:port uuid="b2809250-71fc-4b44-a58d-ef662a0bc079">
Aug 15 17:43:54 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 17:43:54 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:54 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:54 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:54 user nova-compute[73007]:   </metadata>
Aug 15 17:43:54 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:54 user nova-compute[73007]:     <system>
Aug 15 17:43:54 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:54 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:54 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:54 user nova-compute[73007]:       <entry name="serial">c456a6f0-d0d4-4927-85c9-2db4fde3c96f</entry>
Aug 15 17:43:54 user nova-compute[73007]:       <entry name="uuid">c456a6f0-d0d4-4927-85c9-2db4fde3c96f</entry>
Aug 15 17:43:54 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:54 user nova-compute[73007]:     </system>
Aug 15 17:43:54 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:54 user nova-compute[73007]:   <os>
Aug 15 17:43:54 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:54 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:54 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:54 user nova-compute[73007]:   </os>
Aug 15 17:43:54 user nova-compute[73007]:   <features>
Aug 15 17:43:54 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:54 user nova-compute[73007]:     <apic/>
Aug 15 17:43:54 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:54 user nova-compute[73007]:   </features>
Aug 15 17:43:54 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:54 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:54 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:54 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:54 user nova-compute[73007]:   </clock>
Aug 15 17:43:54 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:54 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:54 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:54 user nova-compute[73007]:   </cpu>
Aug 15 17:43:54 user nova-compute[73007]:   <devices>
Aug 15 17:43:54 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:54 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:54 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk"/>
Aug 15 17:43:54 user nova-compute[73007]:       <target dev="sda" bus="scsi"/>
Aug 15 17:43:54 user nova-compute[73007]:       <address type="drive" controller="0" unit="0"/>
Aug 15 17:43:54 user nova-compute[73007]:     </disk>
Aug 15 17:43:54 user nova-compute[73007]:     <disk type="file" device="cdrom">
Aug 15 17:43:54 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 17:43:54 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk.config"/>
Aug 15 17:43:54 user nova-compute[73007]:       <target dev="sdb" bus="scsi"/>
Aug 15 17:43:54 user nova-compute[73007]:       <address type="drive" controller="0" unit="1"/>
Aug 15 17:43:54 user nova-compute[73007]:     </disk>
Aug 15 17:43:54 user nova-compute[73007]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 17:43:54 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:54 user nova-compute[73007]:       <mac address="fa:16:3e:39:ff:2a"/>
Aug 15 17:43:54 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:54 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:54 user nova-compute[73007]:       <target dev="tapb2809250-71"/>
Aug 15 17:43:54 user nova-compute[73007]:     </interface>
Aug 15 17:43:54 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:54 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/console.log" append="off"/>
Aug 15 17:43:54 user nova-compute[73007]:     </serial>
Aug 15 17:43:54 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:54 user nova-compute[73007]:     <video>
Aug 15 17:43:54 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:54 user nova-compute[73007]:     </video>
Aug 15 17:43:54 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:54 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:54 user nova-compute[73007]:     </rng>
Aug 15 17:43:54 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:54 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:54 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:54 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:54 user nova-compute[73007]:   </devices>
Aug 15 17:43:54 user nova-compute[73007]: </domain>
Aug 15 17:43:54 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-457650173',display_name='tempest-AttachSCSIVolumeTestJSON-server-457650173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-457650173',id=8,image_ref='f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9RJNNfL92NnvPAWf7kIStSh88iL8gfd+K2qEYGeG4qSyV+yzqOCD1yRmiFtcHFa4RJMwVVFPpPlImVs93l9XbhCbXeSNV4qSoFEIC8g4jGrjHvcSnV8mTgFA1Hp9OS1Q==',key_name='tempest-keypair-1140898119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee903cb4cf54edbb46d3d735dd5ee4f',ramdisk_id='',reservation_id='r-atad7kru',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-776031099',owner_user_name='tempest-AttachSCSIVolumeTestJSON-776031099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1927ba78a2e84bb7b1ba8c3187a62eac',uuid=c456a6f0-d0d4-4927-85c9-2db4fde3c96f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Converting VIF {"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ff:2a,bridge_name='br-int',has_traffic_filtering=True,id=b2809250-71fc-4b44-a58d-ef662a0bc079,network=Network(0679cb29-1994-47c8-97ea-589eeadfc21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2809250-71') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG os_vif [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ff:2a,bridge_name='br-int',has_traffic_filtering=True,id=b2809250-71fc-4b44-a58d-ef662a0bc079,network=Network(0679cb29-1994-47c8-97ea-589eeadfc21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2809250-71') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2809250-71, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2809250-71, col_values=(('external_ids', {'iface-id': 'b2809250-71fc-4b44-a58d-ef662a0bc079', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ff:2a', 'vm-uuid': 'c456a6f0-d0d4-4927-85c9-2db4fde3c96f'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid 1a098861-c387-4883-9d2c-e69ad9a7760a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:54 user nova-compute[73007]: INFO os_vif [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ff:2a,bridge_name='br-int',has_traffic_filtering=True,id=b2809250-71fc-4b44-a58d-ef662a0bc079,network=Network(0679cb29-1994-47c8-97ea-589eeadfc21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2809250-71')
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] No BDM found with device name sda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] No VIF found with MAC fa:16:3e:39:ff:2a, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Using config drive
Aug 15 17:43:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Successfully created port: 722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.network.neutron [req-5bebdd62-6561-4fd5-bbd0-eeabb9763c13 req-27f201db-9d17-4e37-bbb5-b745224e0eb2 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Updated VIF entry in instance network info cache for port b2809250-71fc-4b44-a58d-ef662a0bc079. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.network.neutron [req-5bebdd62-6561-4fd5-bbd0-eeabb9763c13 req-27f201db-9d17-4e37-bbb5-b745224e0eb2 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Updating instance_info_cache with network_info: [{"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5bebdd62-6561-4fd5-bbd0-eeabb9763c13 req-27f201db-9d17-4e37-bbb5-b745224e0eb2 service nova] Releasing lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:55 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Creating config drive at /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk.config
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpva3skmw9 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpva3skmw9" returned: 0 in 0.067s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Updating instance_info_cache with network_info: [{"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-1a098861-c387-4883-9d2c-e69ad9a7760a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Successfully updated port: 722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquired lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-e8f75510-e70f-4645-bada-bf31bd4e327c req-a5846180-7ece-4b26-9788-11e08ae7c40c service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received event network-changed-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-e8f75510-e70f-4645-bada-bf31bd4e327c req-a5846180-7ece-4b26-9788-11e08ae7c40c service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Refreshing instance network info cache due to event network-changed-722e7669-c824-4ee0-97d6-b048c1000c74. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e8f75510-e70f-4645-bada-bf31bd4e327c req-a5846180-7ece-4b26-9788-11e08ae7c40c service nova] Acquiring lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:43:55 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Updating instance_info_cache with network_info: [{"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Releasing lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Instance network_info: |[{"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e8f75510-e70f-4645-bada-bf31bd4e327c req-a5846180-7ece-4b26-9788-11e08ae7c40c service nova] Acquired lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.network.neutron [req-e8f75510-e70f-4645-bada-bf31bd4e327c req-a5846180-7ece-4b26-9788-11e08ae7c40c service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Refreshing network info cache for port 722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Start _get_guest_xml network_info=[{"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:43:56 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:56 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-636727005',display_name='tempest-TestVolumeSwap-server-636727005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-636727005',id=9,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6KapPTAyyGXNdxYWp6xUMbDIDnIykEpDLmuzAO9f0KNS5CgUXVQ35uHIduxFoUraun6bIye+dJppzvBzlFQITwDlcehCBKPreHI1v5gZvAJsx2C3NplIR/5ZymMRuVDg==',key_name='tempest-keypair-764214141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba216cdf4d404ba3b546cf6448c2021c',ramdisk_id='',reservation_id='r-9rbtonrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1158068750',owner_user_name='tempest-TestVolumeSwap-1158068750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23832aa9aff9406b916174bcbdb8ed25',uuid=76bc99a0-7be4-480c-a7b1-11a9a557c645,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Converting VIF {"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:70:34,bridge_name='br-int',has_traffic_filtering=True,id=722e7669-c824-4ee0-97d6-b048c1000c74,network=Network(03af24bc-ef5e-4416-8f90-63fa29f0acc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap722e7669-c8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lazy-loading 'pci_devices' on Instance uuid 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:43:56 user nova-compute[73007]:   <uuid>76bc99a0-7be4-480c-a7b1-11a9a557c645</uuid>
Aug 15 17:43:56 user nova-compute[73007]:   <name>instance-00000009</name>
Aug 15 17:43:56 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:43:56 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:43:56 user nova-compute[73007]:   <metadata>
Aug 15 17:43:56 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:43:56 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:43:56 user nova-compute[73007]:       <nova:name>tempest-TestVolumeSwap-server-636727005</nova:name>
Aug 15 17:43:56 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:43:56</nova:creationTime>
Aug 15 17:43:56 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:43:56 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:43:56 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:43:56 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:43:56 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:43:56 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:43:56 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:43:56 user nova-compute[73007]:       <nova:owner>
Aug 15 17:43:56 user nova-compute[73007]:         <nova:user uuid="23832aa9aff9406b916174bcbdb8ed25">tempest-TestVolumeSwap-1158068750-project-member</nova:user>
Aug 15 17:43:56 user nova-compute[73007]:         <nova:project uuid="ba216cdf4d404ba3b546cf6448c2021c">tempest-TestVolumeSwap-1158068750</nova:project>
Aug 15 17:43:56 user nova-compute[73007]:       </nova:owner>
Aug 15 17:43:56 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:43:56 user nova-compute[73007]:       <nova:ports>
Aug 15 17:43:56 user nova-compute[73007]:         <nova:port uuid="722e7669-c824-4ee0-97d6-b048c1000c74">
Aug 15 17:43:56 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 17:43:56 user nova-compute[73007]:         </nova:port>
Aug 15 17:43:56 user nova-compute[73007]:       </nova:ports>
Aug 15 17:43:56 user nova-compute[73007]:     </nova:instance>
Aug 15 17:43:56 user nova-compute[73007]:   </metadata>
Aug 15 17:43:56 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:43:56 user nova-compute[73007]:     <system>
Aug 15 17:43:56 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:43:56 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:43:56 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:43:56 user nova-compute[73007]:       <entry name="serial">76bc99a0-7be4-480c-a7b1-11a9a557c645</entry>
Aug 15 17:43:56 user nova-compute[73007]:       <entry name="uuid">76bc99a0-7be4-480c-a7b1-11a9a557c645</entry>
Aug 15 17:43:56 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:43:56 user nova-compute[73007]:     </system>
Aug 15 17:43:56 user nova-compute[73007]:   </sysinfo>
Aug 15 17:43:56 user nova-compute[73007]:   <os>
Aug 15 17:43:56 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:43:56 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:43:56 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:43:56 user nova-compute[73007]:   </os>
Aug 15 17:43:56 user nova-compute[73007]:   <features>
Aug 15 17:43:56 user nova-compute[73007]:     <acpi/>
Aug 15 17:43:56 user nova-compute[73007]:     <apic/>
Aug 15 17:43:56 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:43:56 user nova-compute[73007]:   </features>
Aug 15 17:43:56 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:43:56 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:43:56 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:43:56 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:43:56 user nova-compute[73007]:   </clock>
Aug 15 17:43:56 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:43:56 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:43:56 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:43:56 user nova-compute[73007]:   </cpu>
Aug 15 17:43:56 user nova-compute[73007]:   <devices>
Aug 15 17:43:56 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:43:56 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:43:56 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk"/>
Aug 15 17:43:56 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:43:56 user nova-compute[73007]:     </disk>
Aug 15 17:43:56 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:43:56 user nova-compute[73007]:       <mac address="fa:16:3e:1c:70:34"/>
Aug 15 17:43:56 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:56 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:43:56 user nova-compute[73007]:       <target dev="tap722e7669-c8"/>
Aug 15 17:43:56 user nova-compute[73007]:     </interface>
Aug 15 17:43:56 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:43:56 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/console.log" append="off"/>
Aug 15 17:43:56 user nova-compute[73007]:     </serial>
Aug 15 17:43:56 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:43:56 user nova-compute[73007]:     <video>
Aug 15 17:43:56 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:43:56 user nova-compute[73007]:     </video>
Aug 15 17:43:56 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:43:56 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:43:56 user nova-compute[73007]:     </rng>
Aug 15 17:43:56 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:43:56 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:43:56 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:43:56 user nova-compute[73007]:     </memballoon>
Aug 15 17:43:56 user nova-compute[73007]:   </devices>
Aug 15 17:43:56 user nova-compute[73007]: </domain>
Aug 15 17:43:56 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-636727005',display_name='tempest-TestVolumeSwap-server-636727005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-636727005',id=9,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6KapPTAyyGXNdxYWp6xUMbDIDnIykEpDLmuzAO9f0KNS5CgUXVQ35uHIduxFoUraun6bIye+dJppzvBzlFQITwDlcehCBKPreHI1v5gZvAJsx2C3NplIR/5ZymMRuVDg==',key_name='tempest-keypair-764214141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba216cdf4d404ba3b546cf6448c2021c',ramdisk_id='',reservation_id='r-9rbtonrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1158068750',owner_user_name='tempest-TestVolumeSwap-1158068750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23832aa9aff9406b916174bcbdb8ed25',uuid=76bc99a0-7be4-480c-a7b1-11a9a557c645,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Converting VIF {"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:70:34,bridge_name='br-int',has_traffic_filtering=True,id=722e7669-c824-4ee0-97d6-b048c1000c74,network=Network(03af24bc-ef5e-4416-8f90-63fa29f0acc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap722e7669-c8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG os_vif [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:70:34,bridge_name='br-int',has_traffic_filtering=True,id=722e7669-c824-4ee0-97d6-b048c1000c74,network=Network(03af24bc-ef5e-4416-8f90-63fa29f0acc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap722e7669-c8') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap722e7669-c8, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap722e7669-c8, col_values=(('external_ids', {'iface-id': '722e7669-c824-4ee0-97d6-b048c1000c74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:70:34', 'vm-uuid': '76bc99a0-7be4-480c-a7b1-11a9a557c645'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:56 user nova-compute[73007]: INFO os_vif [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:70:34,bridge_name='br-int',has_traffic_filtering=True,id=722e7669-c824-4ee0-97d6-b048c1000c74,network=Network(03af24bc-ef5e-4416-8f90-63fa29f0acc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap722e7669-c8')
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] No VIF found with MAC fa:16:3e:1c:70:34, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.network.neutron [req-e8f75510-e70f-4645-bada-bf31bd4e327c req-a5846180-7ece-4b26-9788-11e08ae7c40c service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Updated VIF entry in instance network info cache for port 722e7669-c824-4ee0-97d6-b048c1000c74. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG nova.network.neutron [req-e8f75510-e70f-4645-bada-bf31bd4e327c req-a5846180-7ece-4b26-9788-11e08ae7c40c service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Updating instance_info_cache with network_info: [{"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e8f75510-e70f-4645-bada-bf31bd4e327c req-a5846180-7ece-4b26-9788-11e08ae7c40c service nova] Releasing lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG nova.compute.manager [req-0ec68e5a-0fbb-4410-9b94-9f2b99646fcb req-58d2ba5d-8078-4414-bed8-5f282ba53b11 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received event network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0ec68e5a-0fbb-4410-9b94-9f2b99646fcb req-58d2ba5d-8078-4414-bed8-5f282ba53b11 service nova] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0ec68e5a-0fbb-4410-9b94-9f2b99646fcb req-58d2ba5d-8078-4414-bed8-5f282ba53b11 service nova] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0ec68e5a-0fbb-4410-9b94-9f2b99646fcb req-58d2ba5d-8078-4414-bed8-5f282ba53b11 service nova] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG nova.compute.manager [req-0ec68e5a-0fbb-4410-9b94-9f2b99646fcb req-58d2ba5d-8078-4414-bed8-5f282ba53b11 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] No waiting events found dispatching network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:57 user nova-compute[73007]: WARNING nova.compute.manager [req-0ec68e5a-0fbb-4410-9b94-9f2b99646fcb req-58d2ba5d-8078-4414-bed8-5f282ba53b11 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received unexpected event network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 for instance with vm_state building and task_state spawning.
Aug 15 17:43:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-81241608-7f14-41d5-a228-cb948eda0ce0 req-bcf1f8ec-4ba9-4c8b-9aee-1bde35cedbe4 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received event network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81241608-7f14-41d5-a228-cb948eda0ce0 req-bcf1f8ec-4ba9-4c8b-9aee-1bde35cedbe4 service nova] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81241608-7f14-41d5-a228-cb948eda0ce0 req-bcf1f8ec-4ba9-4c8b-9aee-1bde35cedbe4 service nova] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81241608-7f14-41d5-a228-cb948eda0ce0 req-bcf1f8ec-4ba9-4c8b-9aee-1bde35cedbe4 service nova] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-81241608-7f14-41d5-a228-cb948eda0ce0 req-bcf1f8ec-4ba9-4c8b-9aee-1bde35cedbe4 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] No waiting events found dispatching network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:43:59 user nova-compute[73007]: WARNING nova.compute.manager [req-81241608-7f14-41d5-a228-cb948eda0ce0 req-bcf1f8ec-4ba9-4c8b-9aee-1bde35cedbe4 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received unexpected event network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 for instance with vm_state building and task_state spawning.
Aug 15 17:43:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:43:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121441.2574105, 76bc99a0-7be4-480c-a7b1-11a9a557c645 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] VM Resumed (Lifecycle Event)
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Instance spawned successfully.
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121441.2667003, 76bc99a0-7be4-480c-a7b1-11a9a557c645 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] VM Started (Lifecycle Event)
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Instance spawned successfully.
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Took 8.55 seconds to spawn the instance on the hypervisor.
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121441.4006896, c456a6f0-d0d4-4927-85c9-2db4fde3c96f => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] VM Resumed (Lifecycle Event)
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Took 12.36 seconds to spawn the instance on the hypervisor.
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Took 9.86 seconds to build instance.
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121441.4008808, c456a6f0-d0d4-4927-85c9-2db4fde3c96f => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] VM Started (Lifecycle Event)
Aug 15 17:44:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8ac75330-dfbe-49c2-9c61-cbf9461888af tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.084s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:44:01 user nova-compute[73007]: INFO nova.compute.manager [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Took 13.87 seconds to build instance.
Aug 15 17:44:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c88f1666-2f1a-4fc7-83b7-acea3e6750a7 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.154s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:04 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:44:04 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7464MB free_disk=25.77594757080078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 1a098861-c387-4883-9d2c-e69ad9a7760a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance a82e6742-fe31-4693-8db5-50dc97f6072c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6b14b5d1-a493-4506-be76-029324a5aadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 31637822-05e9-4762-b3b3-2bc6e49efb6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 06651cc4-57ab-440f-8fb8-5be64b7441f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c456a6f0-d0d4-4927-85c9-2db4fde3c96f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 17:44:04 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 17:44:05 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:44:05 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:44:05 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:44:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.164s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:44:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-859abfdb-0c06-494a-adab-ed5d23997ee4 req-8382064c-1770-4df5-b825-dbbd32222175 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-859abfdb-0c06-494a-adab-ed5d23997ee4 req-8382064c-1770-4df5-b825-dbbd32222175 service nova] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-859abfdb-0c06-494a-adab-ed5d23997ee4 req-8382064c-1770-4df5-b825-dbbd32222175 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-859abfdb-0c06-494a-adab-ed5d23997ee4 req-8382064c-1770-4df5-b825-dbbd32222175 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-859abfdb-0c06-494a-adab-ed5d23997ee4 req-8382064c-1770-4df5-b825-dbbd32222175 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] No waiting events found dispatching network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:44:12 user nova-compute[73007]: WARNING nova.compute.manager [req-859abfdb-0c06-494a-adab-ed5d23997ee4 req-8382064c-1770-4df5-b825-dbbd32222175 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received unexpected event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc for instance with vm_state active and task_state None.
Aug 15 17:44:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-6fb6325c-de4d-4d39-9e3d-70be1d21781b req-b0eb42f5-f9ca-4e76-9f1f-2f4f7e7d1e92 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6fb6325c-de4d-4d39-9e3d-70be1d21781b req-b0eb42f5-f9ca-4e76-9f1f-2f4f7e7d1e92 service nova] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6fb6325c-de4d-4d39-9e3d-70be1d21781b req-b0eb42f5-f9ca-4e76-9f1f-2f4f7e7d1e92 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6fb6325c-de4d-4d39-9e3d-70be1d21781b req-b0eb42f5-f9ca-4e76-9f1f-2f4f7e7d1e92 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-6fb6325c-de4d-4d39-9e3d-70be1d21781b req-b0eb42f5-f9ca-4e76-9f1f-2f4f7e7d1e92 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] No waiting events found dispatching network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:44:14 user nova-compute[73007]: WARNING nova.compute.manager [req-6fb6325c-de4d-4d39-9e3d-70be1d21781b req-b0eb42f5-f9ca-4e76-9f1f-2f4f7e7d1e92 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received unexpected event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc for instance with vm_state active and task_state None.
Aug 15 17:44:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-d8862df3-6ef2-43bb-86e5-9ed7ce00b6b2 req-784fb976-e598-45ba-b5ce-f725ea70333e service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received event network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d8862df3-6ef2-43bb-86e5-9ed7ce00b6b2 req-784fb976-e598-45ba-b5ce-f725ea70333e service nova] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d8862df3-6ef2-43bb-86e5-9ed7ce00b6b2 req-784fb976-e598-45ba-b5ce-f725ea70333e service nova] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d8862df3-6ef2-43bb-86e5-9ed7ce00b6b2 req-784fb976-e598-45ba-b5ce-f725ea70333e service nova] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-d8862df3-6ef2-43bb-86e5-9ed7ce00b6b2 req-784fb976-e598-45ba-b5ce-f725ea70333e service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] No waiting events found dispatching network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:44:18 user nova-compute[73007]: WARNING nova.compute.manager [req-d8862df3-6ef2-43bb-86e5-9ed7ce00b6b2 req-784fb976-e598-45ba-b5ce-f725ea70333e service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received unexpected event network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a for instance with vm_state active and task_state None.
Aug 15 17:44:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received event network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] No waiting events found dispatching network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:44:20 user nova-compute[73007]: WARNING nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received unexpected event network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a for instance with vm_state active and task_state None.
Aug 15 17:44:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received event network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] No waiting events found dispatching network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:44:20 user nova-compute[73007]: WARNING nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received unexpected event network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 for instance with vm_state active and task_state None.
Aug 15 17:44:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received event network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] No waiting events found dispatching network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:44:20 user nova-compute[73007]: WARNING nova.compute.manager [req-714b1491-4c5b-47ba-8445-c6960accfff7 req-40a9cfee-d25e-4519-8989-b50e458b9c80 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received unexpected event network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 for instance with vm_state active and task_state None.
Aug 15 17:44:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:42 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:44:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:44:42 user nova-compute[73007]: INFO nova.compute.claims [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Claim successful on node user
Aug 15 17:44:43 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:44:43 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:44:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:44:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:44:43 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:44:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:44:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:44:43 user nova-compute[73007]: INFO nova.virt.block_device [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Booting with volume fd22e707-b7fb-458c-ad5d-219854d13f6e at /dev/vda
Aug 15 17:44:43 user nova-compute[73007]: DEBUG nova.policy [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c461e8e715e744c9b0afeef8adb05dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c9eb31865ff4bde98721c68030bc231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:44:43 user nova-compute[73007]: DEBUG os_brick.utils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:44:43 user nova-compute[73007]: INFO oslo.privsep.daemon [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp0pzdr2bf/privsep.sock']
Aug 15 17:44:43 user sudo[84238]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp0pzdr2bf/privsep.sock
Aug 15 17:44:43 user sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 17:44:44 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully created port: 5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:44:44 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully created port: 1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:44:45 user sudo[84238]: pam_unix(sudo:session): session closed for user root
Aug 15 17:44:45 user nova-compute[73007]: INFO oslo.privsep.daemon [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Spawned new privsep daemon via rootwrap
Aug 15 17:44:45 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 17:44:45 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 17:44:45 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 17:44:45 user nova-compute[73007]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84257
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f895417-b1a6-41e4-bc8c-534e9b5d9aa6]: (2,) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully created port: c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aff4dc-e0d8-41bd-b3d3-993d5d1bcfea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:45 user nova-compute[73007]: WARNING os_brick.initiator.connectors.nvmeof [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f3b24e-e198-40fc-bdd7-ccab7a63b16a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc26ce-8019-457f-aab6-681c4ca4040c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[da988d11-6cad-4a54-b5b3-4926969ecf7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:44:45 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:44:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21aff1c-c6ca-429d-89e0-b00c30d015ce]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG os_brick.utils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== get_connector_properties: return (2108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating existing volume attachment record: 7d789871-f03b-41da-b59a-074358f9a513 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:44:45 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully created port: 7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:44:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:46 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully created port: 6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:44:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully updated port: 5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:44:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-b5a658bf-c5c0-4558-8684-b83c10a48c1f req-3487e29e-f39f-4dcb-8df8-a861cd00159e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-changed-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-b5a658bf-c5c0-4558-8684-b83c10a48c1f req-3487e29e-f39f-4dcb-8df8-a861cd00159e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing instance network info cache due to event network-changed-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:44:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b5a658bf-c5c0-4558-8684-b83c10a48c1f req-3487e29e-f39f-4dcb-8df8-a861cd00159e service nova] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b5a658bf-c5c0-4558-8684-b83c10a48c1f req-3487e29e-f39f-4dcb-8df8-a861cd00159e service nova] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:47 user nova-compute[73007]: DEBUG nova.network.neutron [req-b5a658bf-c5c0-4558-8684-b83c10a48c1f req-3487e29e-f39f-4dcb-8df8-a861cd00159e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing network info cache for port 5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:44:47 user nova-compute[73007]: DEBUG nova.network.neutron [req-b5a658bf-c5c0-4558-8684-b83c10a48c1f req-3487e29e-f39f-4dcb-8df8-a861cd00159e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:44:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-b5a658bf-c5c0-4558-8684-b83c10a48c1f req-3487e29e-f39f-4dcb-8df8-a861cd00159e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b5a658bf-c5c0-4558-8684-b83c10a48c1f req-3487e29e-f39f-4dcb-8df8-a861cd00159e service nova] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:49 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully updated port: b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:44:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-0355c8b1-97b3-4063-a05f-634b3a45a472 req-e1c40a82-fd54-4b51-a6c2-4ec478fa01c1 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-changed-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-0355c8b1-97b3-4063-a05f-634b3a45a472 req-e1c40a82-fd54-4b51-a6c2-4ec478fa01c1 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing instance network info cache due to event network-changed-b52b824d-c6b2-4297-ad8c-76c3b1eee05b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:44:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0355c8b1-97b3-4063-a05f-634b3a45a472 req-e1c40a82-fd54-4b51-a6c2-4ec478fa01c1 service nova] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0355c8b1-97b3-4063-a05f-634b3a45a472 req-e1c40a82-fd54-4b51-a6c2-4ec478fa01c1 service nova] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-0355c8b1-97b3-4063-a05f-634b3a45a472 req-e1c40a82-fd54-4b51-a6c2-4ec478fa01c1 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing network info cache for port b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:44:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-0355c8b1-97b3-4063-a05f-634b3a45a472 req-e1c40a82-fd54-4b51-a6c2-4ec478fa01c1 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:44:50 user nova-compute[73007]: DEBUG nova.network.neutron [req-0355c8b1-97b3-4063-a05f-634b3a45a472 req-e1c40a82-fd54-4b51-a6c2-4ec478fa01c1 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0355c8b1-97b3-4063-a05f-634b3a45a472 req-e1c40a82-fd54-4b51-a6c2-4ec478fa01c1 service nova] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:50 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully updated port: 04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:44:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:44:51 user nova-compute[73007]: INFO nova.compute.claims [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Claim successful on node user
Aug 15 17:44:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully updated port: 1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:44:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:44:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Creating image(s)
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "/opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "/opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "/opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-changed-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing instance network info cache due to event network-changed-04ba3529-e558-43a9-b673-ca64d4313656. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing network info cache for port 04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.policy [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b107f48a8a614494a0431c38e37f79f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac3717304e944b3b364bc599eb8e0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:44:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk 1073741824" returned: 0 in 0.161s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.network.neutron [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-changed-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing instance network info cache due to event network-changed-1f69add6-12dc-45a8-adbf-80da2c6332b5. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.network.neutron [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing network info cache for port 1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully updated port: c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.network.neutron [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Cannot resize image /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'migration_context' on Instance uuid 92002335-4c3a-4d9b-ba90-f1840c9142b5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Ensure instance console log exists: /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Successfully created port: 1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:44:53 user nova-compute[73007]: DEBUG nova.network.neutron [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a55dad83-1880-4f49-b985-68020bb7d71e req-1877850f-1eb7-464a-9a40-ce891393473a service nova] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-0903ea23-8bbe-4d9e-89c2-e46cb340819b req-c2214337-1a04-4d7f-af1d-7c0dc3d3fdf5 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-changed-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-0903ea23-8bbe-4d9e-89c2-e46cb340819b req-c2214337-1a04-4d7f-af1d-7c0dc3d3fdf5 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing instance network info cache due to event network-changed-c5f777ec-67fa-4a19-87bf-1cc734b9376e. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:44:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0903ea23-8bbe-4d9e-89c2-e46cb340819b req-c2214337-1a04-4d7f-af1d-7c0dc3d3fdf5 service nova] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0903ea23-8bbe-4d9e-89c2-e46cb340819b req-c2214337-1a04-4d7f-af1d-7c0dc3d3fdf5 service nova] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:53 user nova-compute[73007]: DEBUG nova.network.neutron [req-0903ea23-8bbe-4d9e-89c2-e46cb340819b req-c2214337-1a04-4d7f-af1d-7c0dc3d3fdf5 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing network info cache for port c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:44:53 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully updated port: 7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.neutron [req-0903ea23-8bbe-4d9e-89c2-e46cb340819b req-c2214337-1a04-4d7f-af1d-7c0dc3d3fdf5 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Successfully updated port: 1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquired lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.neutron [req-0903ea23-8bbe-4d9e-89c2-e46cb340819b req-c2214337-1a04-4d7f-af1d-7c0dc3d3fdf5 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0903ea23-8bbe-4d9e-89c2-e46cb340819b req-c2214337-1a04-4d7f-af1d-7c0dc3d3fdf5 service nova] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:54 user nova-compute[73007]: INFO nova.virt.block_device [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Booting with volume c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 at /dev/vdb
Aug 15 17:44:54 user nova-compute[73007]: DEBUG os_brick.utils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f969f62-f528-41cd-8cf4-d600f8ab8d3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b743fb-9f3a-402e-8230-cfa77c5ab061]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246d0f9-4296-4456-b03c-e7eca9ff413e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7eda17-765e-4ba6-8320-637ca2974eb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Updating instance_info_cache with network_info: [{"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:44:54 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[90077900-32c7-4a5a-93a9-618e0ae4d05a]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG os_brick.utils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating existing volume attachment record: 65bb0c10-c6bf-4153-9105-d63add850c14 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Releasing lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Instance network_info: |[{"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Start _get_guest_xml network_info=[{"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:44:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:44:54 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-468230397',display_name='tempest-VolumesSnapshotTestJSON-instance-468230397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-468230397',id=11,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4Y0vApS55kpTjDmOgtwA+fVARncQ+iiQitvemDqkqUHFTTvnG4jx3VywjSmRJyKcdxwzWdYA1soyJhXFA59hMyUpzrrrgIClB9Dm9eb9Vyd5A9hU8EXzc0P3eqe1m1+g==',key_name='tempest-keypair-958649484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dac3717304e944b3b364bc599eb8e0bc',ramdisk_id='',reservation_id='r-5fn7a604',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1500133320',owner_user_name='tempest-VolumesSnapshotTestJSON-1500133320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b107f48a8a614494a0431c38e37f79f6',uuid=92002335-4c3a-4d9b-ba90-f1840c9142b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converting VIF {"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:1f:7c,bridge_name='br-int',has_traffic_filtering=True,id=1f124901-40ef-497d-9479-7bb22833f3d4,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f124901-40') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'pci_devices' on Instance uuid 92002335-4c3a-4d9b-ba90-f1840c9142b5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:44:54 user nova-compute[73007]:   <uuid>92002335-4c3a-4d9b-ba90-f1840c9142b5</uuid>
Aug 15 17:44:54 user nova-compute[73007]:   <name>instance-0000000b</name>
Aug 15 17:44:54 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:44:54 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:44:54 user nova-compute[73007]:   <metadata>
Aug 15 17:44:54 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:44:54 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:44:54 user nova-compute[73007]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-468230397</nova:name>
Aug 15 17:44:54 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:44:54</nova:creationTime>
Aug 15 17:44:54 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:44:54 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:44:54 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:44:54 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:44:54 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:44:54 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:44:54 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:44:54 user nova-compute[73007]:       <nova:owner>
Aug 15 17:44:54 user nova-compute[73007]:         <nova:user uuid="b107f48a8a614494a0431c38e37f79f6">tempest-VolumesSnapshotTestJSON-1500133320-project-member</nova:user>
Aug 15 17:44:54 user nova-compute[73007]:         <nova:project uuid="dac3717304e944b3b364bc599eb8e0bc">tempest-VolumesSnapshotTestJSON-1500133320</nova:project>
Aug 15 17:44:54 user nova-compute[73007]:       </nova:owner>
Aug 15 17:44:54 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:44:54 user nova-compute[73007]:       <nova:ports>
Aug 15 17:44:54 user nova-compute[73007]:         <nova:port uuid="1f124901-40ef-497d-9479-7bb22833f3d4">
Aug 15 17:44:54 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 17:44:54 user nova-compute[73007]:         </nova:port>
Aug 15 17:44:54 user nova-compute[73007]:       </nova:ports>
Aug 15 17:44:54 user nova-compute[73007]:     </nova:instance>
Aug 15 17:44:54 user nova-compute[73007]:   </metadata>
Aug 15 17:44:54 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:44:54 user nova-compute[73007]:     <system>
Aug 15 17:44:54 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:44:54 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:44:54 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:44:54 user nova-compute[73007]:       <entry name="serial">92002335-4c3a-4d9b-ba90-f1840c9142b5</entry>
Aug 15 17:44:54 user nova-compute[73007]:       <entry name="uuid">92002335-4c3a-4d9b-ba90-f1840c9142b5</entry>
Aug 15 17:44:54 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:44:54 user nova-compute[73007]:     </system>
Aug 15 17:44:54 user nova-compute[73007]:   </sysinfo>
Aug 15 17:44:54 user nova-compute[73007]:   <os>
Aug 15 17:44:54 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:44:54 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:44:54 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:44:54 user nova-compute[73007]:   </os>
Aug 15 17:44:54 user nova-compute[73007]:   <features>
Aug 15 17:44:54 user nova-compute[73007]:     <acpi/>
Aug 15 17:44:54 user nova-compute[73007]:     <apic/>
Aug 15 17:44:54 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:44:54 user nova-compute[73007]:   </features>
Aug 15 17:44:54 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:44:54 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:44:54 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:44:54 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:44:54 user nova-compute[73007]:   </clock>
Aug 15 17:44:54 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:44:54 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:44:54 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:44:54 user nova-compute[73007]:   </cpu>
Aug 15 17:44:54 user nova-compute[73007]:   <devices>
Aug 15 17:44:54 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:44:54 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:44:54 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk"/>
Aug 15 17:44:54 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:44:54 user nova-compute[73007]:     </disk>
Aug 15 17:44:54 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:44:54 user nova-compute[73007]:       <mac address="fa:16:3e:16:1f:7c"/>
Aug 15 17:44:54 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:44:54 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:44:54 user nova-compute[73007]:       <target dev="tap1f124901-40"/>
Aug 15 17:44:54 user nova-compute[73007]:     </interface>
Aug 15 17:44:54 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:44:54 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/console.log" append="off"/>
Aug 15 17:44:54 user nova-compute[73007]:     </serial>
Aug 15 17:44:54 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:44:54 user nova-compute[73007]:     <video>
Aug 15 17:44:54 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:44:54 user nova-compute[73007]:     </video>
Aug 15 17:44:54 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:44:54 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:44:54 user nova-compute[73007]:     </rng>
Aug 15 17:44:54 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:44:54 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:44:54 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:44:54 user nova-compute[73007]:     </memballoon>
Aug 15 17:44:54 user nova-compute[73007]:   </devices>
Aug 15 17:44:54 user nova-compute[73007]: </domain>
Aug 15 17:44:54 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-468230397',display_name='tempest-VolumesSnapshotTestJSON-instance-468230397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-468230397',id=11,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4Y0vApS55kpTjDmOgtwA+fVARncQ+iiQitvemDqkqUHFTTvnG4jx3VywjSmRJyKcdxwzWdYA1soyJhXFA59hMyUpzrrrgIClB9Dm9eb9Vyd5A9hU8EXzc0P3eqe1m1+g==',key_name='tempest-keypair-958649484',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dac3717304e944b3b364bc599eb8e0bc',ramdisk_id='',reservation_id='r-5fn7a604',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1500133320',owner_user_name='tempest-VolumesSnapshotTestJSON-1500133320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b107f48a8a614494a0431c38e37f79f6',uuid=92002335-4c3a-4d9b-ba90-f1840c9142b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converting VIF {"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:1f:7c,bridge_name='br-int',has_traffic_filtering=True,id=1f124901-40ef-497d-9479-7bb22833f3d4,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f124901-40') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG os_vif [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:1f:7c,bridge_name='br-int',has_traffic_filtering=True,id=1f124901-40ef-497d-9479-7bb22833f3d4,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f124901-40') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f124901-40, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f124901-40, col_values=(('external_ids', {'iface-id': '1f124901-40ef-497d-9479-7bb22833f3d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:1f:7c', 'vm-uuid': '92002335-4c3a-4d9b-ba90-f1840c9142b5'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:54 user nova-compute[73007]: INFO os_vif [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:1f:7c,bridge_name='br-int',has_traffic_filtering=True,id=1f124901-40ef-497d-9479-7bb22833f3d4,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f124901-40')
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Successfully updated port: 6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:44:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No VIF found with MAC fa:16:3e:16:1f:7c, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-changed-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing instance network info cache due to event network-changed-7fde4098-19fb-4c28-98ad-1261432f29a7. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:44:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-b21c0d81-4783-464e-8a4a-58e84a3c21b9 req-9d8caf21-2a6b-4394-9f56-25c1452c4bce service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received event network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b21c0d81-4783-464e-8a4a-58e84a3c21b9 req-9d8caf21-2a6b-4394-9f56-25c1452c4bce service nova] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b21c0d81-4783-464e-8a4a-58e84a3c21b9 req-9d8caf21-2a6b-4394-9f56-25c1452c4bce service nova] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b21c0d81-4783-464e-8a4a-58e84a3c21b9 req-9d8caf21-2a6b-4394-9f56-25c1452c4bce service nova] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-b21c0d81-4783-464e-8a4a-58e84a3c21b9 req-9d8caf21-2a6b-4394-9f56-25c1452c4bce service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] No waiting events found dispatching network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:44:56 user nova-compute[73007]: WARNING nova.compute.manager [req-b21c0d81-4783-464e-8a4a-58e84a3c21b9 req-9d8caf21-2a6b-4394-9f56-25c1452c4bce service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received unexpected event network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 for instance with vm_state building and task_state spawning.
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:44:56 user nova-compute[73007]: INFO nova.compute.claims [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Claim successful on node user
Aug 15 17:44:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:44:57 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:44:57 user nova-compute[73007]: INFO nova.virt.block_device [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Booting with volume 87980b2a-6193-4ef5-bd17-070e51a10764 at /dev/vda
Aug 15 17:44:57 user nova-compute[73007]: DEBUG os_brick.utils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[102449dd-27d9-4ff1-911a-ae1a7c10179e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2497e89a-ed63-4452-b97d-36ce2f50bbb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65b2580-06d9-4cd6-b696-8911d096ce72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be4329-4ae0-4f51-9611-ce68bdf12856]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.policy [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f59c9aec5ab24c6188ddf21c5af35d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677e7d9c21cd4f6fa9df0b9249060855', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:44:57 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d32f40-0124-4c43-a61d-9024064c5ae0]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG os_brick.utils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating existing volume attachment record: 0c1f79f5-2bf1-4a0f-a430-e9128a876499 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [{"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance network_info: |[{"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:57 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing network info cache for port 7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121498.4564166, 92002335-4c3a-4d9b-ba90-f1840c9142b5 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:44:58 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] VM Resumed (Lifecycle Event)
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:44:58 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Instance spawned successfully.
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:44:58 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121498.458415, 92002335-4c3a-4d9b-ba90-f1840c9142b5 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:44:58 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] VM Started (Lifecycle Event)
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ed0b2e7-010b-4086-b74f-b8b2ed80a220 req-d548de89-f0bc-45fc-bf7d-ff5542be1306 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received event network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ed0b2e7-010b-4086-b74f-b8b2ed80a220 req-d548de89-f0bc-45fc-bf7d-ff5542be1306 service nova] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ed0b2e7-010b-4086-b74f-b8b2ed80a220 req-d548de89-f0bc-45fc-bf7d-ff5542be1306 service nova] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ed0b2e7-010b-4086-b74f-b8b2ed80a220 req-d548de89-f0bc-45fc-bf7d-ff5542be1306 service nova] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ed0b2e7-010b-4086-b74f-b8b2ed80a220 req-d548de89-f0bc-45fc-bf7d-ff5542be1306 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] No waiting events found dispatching network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:44:58 user nova-compute[73007]: WARNING nova.compute.manager [req-1ed0b2e7-010b-4086-b74f-b8b2ed80a220 req-d548de89-f0bc-45fc-bf7d-ff5542be1306 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received unexpected event network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 for instance with vm_state building and task_state spawning.
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully created port: 512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updated VIF entry in instance network info cache for port 7fde4098-19fb-4c28-98ad-1261432f29a7. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [{"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:58 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:44:58 user nova-compute[73007]: INFO nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received event network-changed-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Refreshing instance network info cache due to event network-changed-1f124901-40ef-497d-9479-7bb22833f3d4. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Acquiring lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Acquired lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Refreshing network info cache for port 1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:58 user nova-compute[73007]: INFO nova.compute.manager [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Took 7.68 seconds to build instance.
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1767b6ee-d451-4d56-a78a-620cf19d1506 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.826s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Updated VIF entry in instance network info cache for port 1f124901-40ef-497d-9479-7bb22833f3d4. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Updating instance_info_cache with network_info: [{"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully created port: 95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Releasing lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-changed-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing instance network info cache due to event network-changed-6da276e6-e821-4371-b057-10a96c54117c. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing network info cache for port 6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:44:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updated VIF entry in instance network info cache for port 6da276e6-e821-4371-b057-10a96c54117c. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG nova.network.neutron [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [{"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2268b75d-0314-4fd2-b9e0-4b5b380e4b49 req-b70337e4-b2c3-493e-a7e4-4e65f90d4ccc service nova] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully created port: db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully created port: f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully created port: 7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully updated port: 512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-8d60b233-c195-4765-9d04-7d59a0f18449 req-2f4c5a90-bc2b-42c7-860b-ab92b9acea58 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-changed-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-8d60b233-c195-4765-9d04-7d59a0f18449 req-2f4c5a90-bc2b-42c7-860b-ab92b9acea58 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing instance network info cache due to event network-changed-512fb710-a869-4764-aabc-a5589e500850. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8d60b233-c195-4765-9d04-7d59a0f18449 req-2f4c5a90-bc2b-42c7-860b-ab92b9acea58 service nova] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8d60b233-c195-4765-9d04-7d59a0f18449 req-2f4c5a90-bc2b-42c7-860b-ab92b9acea58 service nova] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-8d60b233-c195-4765-9d04-7d59a0f18449 req-2f4c5a90-bc2b-42c7-860b-ab92b9acea58 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing network info cache for port 512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:03 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:45:03 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=6956MB free_disk=25.661449432373047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-8d60b233-c195-4765-9d04-7d59a0f18449 req-2f4c5a90-bc2b-42c7-860b-ab92b9acea58 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 1a098861-c387-4883-9d2c-e69ad9a7760a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance a82e6742-fe31-4693-8db5-50dc97f6072c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6b14b5d1-a493-4506-be76-029324a5aadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 31637822-05e9-4762-b3b3-2bc6e49efb6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 06651cc4-57ab-440f-8fb8-5be64b7441f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c456a6f0-d0d4-4927-85c9-2db4fde3c96f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance f7fc8ce3-8caa-49b7-9a76-601016e3cf31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 92002335-4c3a-4d9b-ba90-f1840c9142b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e90005bb-24fc-4f17-9189-50b8ebd906ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-8d60b233-c195-4765-9d04-7d59a0f18449 req-2f4c5a90-bc2b-42c7-860b-ab92b9acea58 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8d60b233-c195-4765-9d04-7d59a0f18449 req-2f4c5a90-bc2b-42c7-860b-ab92b9acea58 service nova] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully updated port: c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:45:04 user nova-compute[73007]: INFO nova.virt.block_device [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Booting with volume 04da325e-2248-4e39-88df-629822283559 at /dev/vdc
Aug 15 17:45:04 user nova-compute[73007]: DEBUG os_brick.utils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d29a519-703e-497c-a16b-211d30b0abed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c57500-c7ee-40fc-8c64-e8d1e27e1f86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[029bd30a-b5e9-4ad9-8977-7ce4e683f3c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27da481-7aef-4331-974b-a28ee8505af9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:04 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de39a43e-4e71-431d-9799-0ddc1652836e]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG os_brick.utils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating existing volume attachment record: b8e71aef-e7b4-4e9e-b0a1-9cb9ee0649e2 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG nova.objects.instance [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lazy-loading 'flavor' on Instance uuid 1a098861-c387-4883-9d2c-e69ad9a7760a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-14b8b7d4-2f09-4b6a-8506-47164460de48 req-d707616f-3e71-4aa2-aaef-54e177cfb5fa service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-changed-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-14b8b7d4-2f09-4b6a-8506-47164460de48 req-d707616f-3e71-4aa2-aaef-54e177cfb5fa service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing instance network info cache due to event network-changed-c2ed06db-22e0-4601-a79a-fce4edb9d325. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-14b8b7d4-2f09-4b6a-8506-47164460de48 req-d707616f-3e71-4aa2-aaef-54e177cfb5fa service nova] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-14b8b7d4-2f09-4b6a-8506-47164460de48 req-d707616f-3e71-4aa2-aaef-54e177cfb5fa service nova] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG nova.network.neutron [req-14b8b7d4-2f09-4b6a-8506-47164460de48 req-d707616f-3e71-4aa2-aaef-54e177cfb5fa service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing network info cache for port c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG nova.network.neutron [req-14b8b7d4-2f09-4b6a-8506-47164460de48 req-d707616f-3e71-4aa2-aaef-54e177cfb5fa service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:05 user nova-compute[73007]: INFO nova.compute.manager [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Attaching volume 87bca645-fac2-42c5-9d1d-b23e4082c2b4 to /dev/vdb
Aug 15 17:45:05 user nova-compute[73007]: DEBUG os_brick.utils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[09169556-a095-4912-be08-f334673ce340]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1beadef-809b-4f23-8b7f-ded60dac8ffd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b67e04a-a0d5-4fbf-9f12-46969aacfe63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[889c1cb2-f443-4a59-a429-44a92639789d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:05 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f8e35-3b92-41d2-825a-afbd37fc2f5d]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG os_brick.utils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Updating existing volume attachment record: 8678c8bb-f868-4f73-865e-db8f002de39e {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully updated port: e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG nova.network.neutron [req-14b8b7d4-2f09-4b6a-8506-47164460de48 req-d707616f-3e71-4aa2-aaef-54e177cfb5fa service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-14b8b7d4-2f09-4b6a-8506-47164460de48 req-d707616f-3e71-4aa2-aaef-54e177cfb5fa service nova] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-81d76e2e-15a0-4f3e-ae12-2fb00d22fb98 req-d422185a-737b-44da-9725-fca111c20b73 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-changed-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-81d76e2e-15a0-4f3e-ae12-2fb00d22fb98 req-d422185a-737b-44da-9725-fca111c20b73 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Refreshing instance network info cache due to event network-changed-ddf68e4b-1015-4964-9b62-d41585fd04fc. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81d76e2e-15a0-4f3e-ae12-2fb00d22fb98 req-d422185a-737b-44da-9725-fca111c20b73 service nova] Acquiring lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81d76e2e-15a0-4f3e-ae12-2fb00d22fb98 req-d422185a-737b-44da-9725-fca111c20b73 service nova] Acquired lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-81d76e2e-15a0-4f3e-ae12-2fb00d22fb98 req-d422185a-737b-44da-9725-fca111c20b73 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Refreshing network info cache for port ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-81d76e2e-15a0-4f3e-ae12-2fb00d22fb98 req-d422185a-737b-44da-9725-fca111c20b73 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updated VIF entry in instance network info cache for port ddf68e4b-1015-4964-9b62-d41585fd04fc. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-81d76e2e-15a0-4f3e-ae12-2fb00d22fb98 req-d422185a-737b-44da-9725-fca111c20b73 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81d76e2e-15a0-4f3e-ae12-2fb00d22fb98 req-d422185a-737b-44da-9725-fca111c20b73 service nova] Releasing lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully updated port: 95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-changed-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing instance network info cache due to event network-changed-e9359e36-f5a8-4f88-8375-2979cc99fa3a. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing network info cache for port e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-ce45446e-88ce-4f95-888f-eab7519774d6 req-b9cfef93-2833-4a46-84f6-108f9b9d97e4 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received event network-changed-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-ce45446e-88ce-4f95-888f-eab7519774d6 req-b9cfef93-2833-4a46-84f6-108f9b9d97e4 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Refreshing instance network info cache due to event network-changed-4ca037da-7acd-4a45-a808-6a655ae3416b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ce45446e-88ce-4f95-888f-eab7519774d6 req-b9cfef93-2833-4a46-84f6-108f9b9d97e4 service nova] Acquiring lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ce45446e-88ce-4f95-888f-eab7519774d6 req-b9cfef93-2833-4a46-84f6-108f9b9d97e4 service nova] Acquired lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-ce45446e-88ce-4f95-888f-eab7519774d6 req-b9cfef93-2833-4a46-84f6-108f9b9d97e4 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Refreshing network info cache for port 4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-changed-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing instance network info cache due to event network-changed-95359884-3e57-4e19-b56c-4ce0720f9d9b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing network info cache for port 95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-ce45446e-88ce-4f95-888f-eab7519774d6 req-b9cfef93-2833-4a46-84f6-108f9b9d97e4 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updated VIF entry in instance network info cache for port 4ca037da-7acd-4a45-a808-6a655ae3416b. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-ce45446e-88ce-4f95-888f-eab7519774d6 req-b9cfef93-2833-4a46-84f6-108f9b9d97e4 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updating instance_info_cache with network_info: [{"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ce45446e-88ce-4f95-888f-eab7519774d6 req-b9cfef93-2833-4a46-84f6-108f9b9d97e4 service nova] Releasing lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:08 user nova-compute[73007]: INFO nova.virt.block_device [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Booting with volume 7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 at /dev/vdb
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully updated port: db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45a480bf-c4e8-469a-a0bd-6207c37a2de2 req-7041bcf2-7e11-4a08-8c44-330293f05745 service nova] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-9e43f1ad-9212-4c54-aa92-9af0131fdc2d req-8dd8786a-92e4-4df0-83b1-077be468219e service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-changed-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-9e43f1ad-9212-4c54-aa92-9af0131fdc2d req-8dd8786a-92e4-4df0-83b1-077be468219e service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Refreshing instance network info cache due to event network-changed-2c926c8a-890e-40cf-b2c4-906f890e4791. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e43f1ad-9212-4c54-aa92-9af0131fdc2d req-8dd8786a-92e4-4df0-83b1-077be468219e service nova] Acquiring lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e43f1ad-9212-4c54-aa92-9af0131fdc2d req-8dd8786a-92e4-4df0-83b1-077be468219e service nova] Acquired lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e43f1ad-9212-4c54-aa92-9af0131fdc2d req-8dd8786a-92e4-4df0-83b1-077be468219e service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Refreshing network info cache for port 2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG os_brick.utils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6a4895-9b06-4285-b5fe-6860a68e53c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573fe3c-1022-49d1-9344-dc66fc5a9dcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[937f9bac-64e6-4f65-8d7b-240faa7a8226]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ff5889-929d-445e-8cf3-3d520f699a15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:08 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d6354-4166-402e-8cde-1a2ed4731907]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG os_brick.utils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:08 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating existing volume attachment record: d6aad76a-899e-4a5c-bae9-636068e5711b {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e6f5e960-d5d0-47c5-9722-11ff94a8be93 req-9e14508f-5388-4ee9-af1d-5937aee9c232 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-changed-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e6f5e960-d5d0-47c5-9722-11ff94a8be93 req-9e14508f-5388-4ee9-af1d-5937aee9c232 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing instance network info cache due to event network-changed-db8630a0-4d10-4051-9849-12f968c27580. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6f5e960-d5d0-47c5-9722-11ff94a8be93 req-9e14508f-5388-4ee9-af1d-5937aee9c232 service nova] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6f5e960-d5d0-47c5-9722-11ff94a8be93 req-9e14508f-5388-4ee9-af1d-5937aee9c232 service nova] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG nova.network.neutron [req-e6f5e960-d5d0-47c5-9722-11ff94a8be93 req-9e14508f-5388-4ee9-af1d-5937aee9c232 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing network info cache for port db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG nova.network.neutron [req-e6f5e960-d5d0-47c5-9722-11ff94a8be93 req-9e14508f-5388-4ee9-af1d-5937aee9c232 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e43f1ad-9212-4c54-aa92-9af0131fdc2d req-8dd8786a-92e4-4df0-83b1-077be468219e service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updated VIF entry in instance network info cache for port 2c926c8a-890e-40cf-b2c4-906f890e4791. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e43f1ad-9212-4c54-aa92-9af0131fdc2d req-8dd8786a-92e4-4df0-83b1-077be468219e service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e43f1ad-9212-4c54-aa92-9af0131fdc2d req-8dd8786a-92e4-4df0-83b1-077be468219e service nova] Releasing lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG nova.network.neutron [req-e6f5e960-d5d0-47c5-9722-11ff94a8be93 req-9e14508f-5388-4ee9-af1d-5937aee9c232 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6f5e960-d5d0-47c5-9722-11ff94a8be93 req-9e14508f-5388-4ee9-af1d-5937aee9c232 service nova] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully updated port: f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:45:10 user nova-compute[73007]: DEBUG nova.compute.manager [req-30c9e7da-0b4b-46ce-b7ea-9b83a9610ff4 req-897a700e-6c0f-48f6-9feb-b74a36869318 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-changed-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:10 user nova-compute[73007]: DEBUG nova.compute.manager [req-30c9e7da-0b4b-46ce-b7ea-9b83a9610ff4 req-897a700e-6c0f-48f6-9feb-b74a36869318 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Refreshing instance network info cache due to event network-changed-74017a60-7a29-446b-9f9d-d26f80ddbba6. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-30c9e7da-0b4b-46ce-b7ea-9b83a9610ff4 req-897a700e-6c0f-48f6-9feb-b74a36869318 service nova] Acquiring lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-30c9e7da-0b4b-46ce-b7ea-9b83a9610ff4 req-897a700e-6c0f-48f6-9feb-b74a36869318 service nova] Acquired lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:10 user nova-compute[73007]: DEBUG nova.network.neutron [req-30c9e7da-0b4b-46ce-b7ea-9b83a9610ff4 req-897a700e-6c0f-48f6-9feb-b74a36869318 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Refreshing network info cache for port 74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Successfully updated port: 7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-changed-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing instance network info cache due to event network-changed-f2dc89bb-161d-4512-a9b4-56c6f1156d93. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-30c9e7da-0b4b-46ce-b7ea-9b83a9610ff4 req-897a700e-6c0f-48f6-9feb-b74a36869318 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updated VIF entry in instance network info cache for port 74017a60-7a29-446b-9f9d-d26f80ddbba6. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-30c9e7da-0b4b-46ce-b7ea-9b83a9610ff4 req-897a700e-6c0f-48f6-9feb-b74a36869318 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-30c9e7da-0b4b-46ce-b7ea-9b83a9610ff4 req-897a700e-6c0f-48f6-9feb-b74a36869318 service nova] Releasing lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:12 user nova-compute[73007]: INFO nova.compute.manager [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] instance snapshotting
Aug 15 17:45:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Beginning live snapshot process
Aug 15 17:45:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json -f qcow2 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json -f qcow2" returned: 0 in 0.237s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json -f qcow2 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw98t4gcw/e05ca1b0f62041d9835e3746211dc1f1.delta 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw98t4gcw/e05ca1b0f62041d9835e3746211dc1f1.delta 1073741824" returned: 0 in 0.052s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 17:45:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73007) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 17:45:13 user nova-compute[73007]: INFO nova.virt.libvirt.host [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] UEFI support detected
Aug 15 17:45:13 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance network_info: |[{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing network info cache for port f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updated VIF entry in instance network info cache for port f2dc89bb-161d-4512-a9b4-56c6f1156d93. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-changed-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing instance network info cache due to event network-changed-7ec98d55-c39e-4aa1-9616-03f4d44bfb09. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing network info cache for port 7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:45:14 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 17:45:14 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw98t4gcw/e05ca1b0f62041d9835e3746211dc1f1.delta /opt/stack/data/nova/instances/snapshots/tmpw98t4gcw/e05ca1b0f62041d9835e3746211dc1f1 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updated VIF entry in instance network info cache for port 7ec98d55-c39e-4aa1-9616-03f4d44bfb09. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08d1b041-8a94-4d96-8e28-af5be72a2802 req-66951479-6ca5-4674-a6b8-cbd1088e8df1 service nova] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw98t4gcw/e05ca1b0f62041d9835e3746211dc1f1.delta /opt/stack/data/nova/instances/snapshots/tmpw98t4gcw/e05ca1b0f62041d9835e3746211dc1f1" returned: 0 in 0.320s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Snapshot extracted, beginning image upload
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:45:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Creating image(s)
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Ensure instance console log exists: /opt/stack/data/nova/instances/f7fc8ce3-8caa-49b7-9a76-601016e3cf31/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Start _get_guest_xml network_info=[{"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTatvSkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd22e707-b7fb-458c-ad5d-219854d13f6e', 'serial': 'fd22e707-b7fb-458c-ad5d-219854d13f6e'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '7d789871-f03b-41da-b59a-074358f9a513', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzajxMpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04', 'serial': 'c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '65bb0c10-c6bf-4153-9105-d63add850c14', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcAPjBES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31', 'attached_at': '', 'detached_at': '', 'volume_id': '04da325e-2248-4e39-88df-629822283559', 'serial': '04da325e-2248-4e39-88df-629822283559'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': 'b8e71aef-e7b4-4e9e-b0a1-9cb9ee0649e2', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.objects.instance [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:16 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:45:16 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connector [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Factory for ISCSI on None {{(pid=73007) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTatvSkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:16 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:16 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:16 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa2c9c-eb5f-4935-9c24-e2d2f767e531]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:16 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b72741-6c4d-4579-82c1-727d932e3d0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e] added
Aug 15 17:45:16 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94718b1-634c-48aa-928d-0b679915ec22]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5befc6-6110-4b79-8954-fa7babb07649]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTatvSkQ {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LTatvSkQ" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[00499054-a65e-4311-9990-e8336afed6a7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LTatvSkQ'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0667d57c-31d6-40c8-b9d8-0dd059c673a2]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG nova.objects.instance [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[000204d8-910b-44c2-8f51-f6d29938ad53]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:45:16 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:45:16 user nova-compute[73007]:  {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:16 user nova-compute[73007]: WARNING os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 17:45:16 user nova-compute[73007]: 
Aug 15 17:45:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:17 user nova-compute[73007]: INFO nova.compute.manager [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Attaching volume b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b to /dev/vdb
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4968ed13-8214-4fe5-b378-73b2fcdfd42a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e, portal: 172.16.0.220,3260]
Aug 15 17:45:17 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[038fdd93-d1d4-46ae-aaf5-a8d39a564e77]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a96cce-76cd-41b2-a34c-9a2fe4479dd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.utils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d4b785-6db3-4d1d-abc1-6814354fd630]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTatvSkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c15a5-7680-4b46-b383-f6223f861255]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec60216-59cb-4449-b599-4391435425d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[27040841-53cf-4cf9-88e5-f0ef0d82f06f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9653ffe-9524-4237-aeee-0c0a3bb13921]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:17 user nova-compute[73007]: INFO nova.compute.manager [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Attaching volume 71574eb8-e7fd-402a-8b17-9d8fee4997ff to /dev/vdb
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:17 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3037493e-6483-446c-9f14-768a073172ed]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG os_brick.utils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updating existing volume attachment record: eb3f0fc3-c643-4f68-8665-13f9cca0872c {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:17 user nova-compute[73007]: INFO nova.compute.manager [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Shelving
Aug 15 17:45:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:17 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Snapshot image upload complete
Aug 15 17:45:17 user nova-compute[73007]: INFO nova.compute.manager [None req-fe777a68-814c-4721-9582-6266a8285007 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Took 5.70 seconds to snapshot the instance on the hypervisor.
Aug 15 17:45:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26434616266303764', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434616266303764', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzajxMpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:18 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:18 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:18 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d162b9f5-ec66-4ea6-866d-e26aa46baa58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:18 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdebebc-14fa-441b-a23c-adbf800f6ead]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04] added
Aug 15 17:45:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c080ddc-d80d-4dca-a44c-f1459f599a28]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3ee3cd-13a7-4840-aecd-e9512733c1f7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzajxMpP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzajxMpP" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc253dc-d6c9-44cb-b2cb-1f7044be34c3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dzajxMpP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-bf8c3b71-256f-4e44-b48d-ec62d4cc0f30 req-a33bb761-9a3b-45fd-b3c3-8b049e0437be service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-unplugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bf8c3b71-256f-4e44-b48d-ec62d4cc0f30 req-a33bb761-9a3b-45fd-b3c3-8b049e0437be service nova] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bf8c3b71-256f-4e44-b48d-ec62d4cc0f30 req-a33bb761-9a3b-45fd-b3c3-8b049e0437be service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bf8c3b71-256f-4e44-b48d-ec62d4cc0f30 req-a33bb761-9a3b-45fd-b3c3-8b049e0437be service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-bf8c3b71-256f-4e44-b48d-ec62d4cc0f30 req-a33bb761-9a3b-45fd-b3c3-8b049e0437be service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] No waiting events found dispatching network-vif-unplugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:18 user nova-compute[73007]: WARNING nova.compute.manager [req-bf8c3b71-256f-4e44-b48d-ec62d4cc0f30 req-a33bb761-9a3b-45fd-b3c3-8b049e0437be service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received unexpected event network-vif-unplugged-ddf68e4b-1015-4964-9b62-d41585fd04fc for instance with vm_state active and task_state shelving.
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c632303-7e96-406c-abf0-fd73c7b87ea1]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[317420d6-01da-4958-8875-2ee1ec27b37f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22d1b7e-6c00-42be-aa97-725cdebcb83f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04, portal: 172.16.0.220,3260]
Aug 15 17:45:18 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7334b65a-c0c7-4e30-b417-f8e8e1994ffd]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf06abe1-4fa2-4849-8ba8-c8edfb89cf23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:18 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:18 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53070a7c-da94-4ab1-9e43-6f4899ba43c7]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzajxMpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance destroyed successfully.
Aug 15 17:45:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Beginning cold snapshot process
Aug 15 17:45:18 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:45:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk /opt/stack/data/nova/instances/snapshots/tmpj8fwt5h4/2d0e7730f29f415694267e1b9b75cc35 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk /opt/stack/data/nova/instances/snapshots/tmpj8fwt5h4/2d0e7730f29f415694267e1b9b75cc35" returned: 0 in 0.594s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Snapshot extracted, beginning image upload
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23538646536653937', 'path': '/dev/sdc'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538646536653937', 'path': '/dev/sdc'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHslTWfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:19 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:19 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:19 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcAPjBES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:19 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b2de7e-cd5c-4d56-be50-e29df4b51f5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:19 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.utils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9f4985-e6a7-4198-a327-40798c36f171]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4] added
Aug 15 17:45:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5b7a8-5a7f-4671-abb9-6d04f9358aba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35a716-5a5c-4265-a781-078509d718f8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[512d84c6-b44d-44f3-b0c6-ee3eedb0f049]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a1c16b-0e0e-46cd-9999-e977ae6ea804]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHslTWfx {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[741d8d3a-d253-4d8e-9130-2a182cbbb9ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf2011-5a36-4320-af09-8ba08d9408bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:19 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[679a9b2d-412f-4766-b1e4-9ace0af63dc5]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.utils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating existing volume attachment record: e9e02e7c-60e0-4e66-aa8d-778ffdb6714b {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHslTWfx" returned: 0 in 0.128s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6415de4a-d792-4d19-910e-40a3abedbb21]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZHslTWfx'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b3c29-b057-4f34-b659-390f8821cd6d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d653e9-9794-4c97-8b4e-18bf94751d02]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:19 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:19 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e96add-0a25-49ae-8c56-09f84e8c11e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4, portal: 172.16.0.220,3260]
Aug 15 17:45:19 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[582b510d-e5ff-4ab7-802f-5353065df117]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2c7cdb-23bf-4292-b4e1-13c903df0eb7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:20 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:20 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:20 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:20 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929f41e-b6af-4b17-b622-e242b92f3cb8]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:20 user nova-compute[73007]: INFO nova.virt.block_device [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Booting with volume 1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 at /dev/vdc
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.utils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-dbdb11a3-0286-42ef-99a0-0393d72daad1 req-2021837e-c687-4e1d-851c-0b4107ba64a6 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dbdb11a3-0286-42ef-99a0-0393d72daad1 req-2021837e-c687-4e1d-851c-0b4107ba64a6 service nova] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dbdb11a3-0286-42ef-99a0-0393d72daad1 req-2021837e-c687-4e1d-851c-0b4107ba64a6 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dbdb11a3-0286-42ef-99a0-0393d72daad1 req-2021837e-c687-4e1d-851c-0b4107ba64a6 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-dbdb11a3-0286-42ef-99a0-0393d72daad1 req-2021837e-c687-4e1d-851c-0b4107ba64a6 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] No waiting events found dispatching network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:20 user nova-compute[73007]: WARNING nova.compute.manager [req-dbdb11a3-0286-42ef-99a0-0393d72daad1 req-2021837e-c687-4e1d-851c-0b4107ba64a6 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received unexpected event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc46c20-a5b4-4467-b819-223cca3fb957]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c56a737-304e-486e-b99d-f444f8d3e6ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d3023c-3e9e-43fb-a741-589b6c6457cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c284b207-22bf-40c6-8036-702f073f8112]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:20 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c3b36a-20cf-4218-94bd-d2046b7af398]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG os_brick.utils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:20 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating existing volume attachment record: 86898145-e5fc-4ff0-b624-156057ef4aed {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHslTWfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23131613932313261', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131613932313261', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.471s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:21 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:21 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lazy-loading 'flavor' on Instance uuid 1a098861-c387-4883-9d2c-e69ad9a7760a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f57c47-fa08-49c0-a339-73a5cce60b06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:21 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:45:21 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:21 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:45:21 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:21 user nova-compute[73007]:   <serial>87bca645-fac2-42c5-9d1d-b23e4082c2b4</serial>
Aug 15 17:45:21 user nova-compute[73007]: </disk>
Aug 15 17:45:21 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3934498d-c852-4886-800e-98117fe72efa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559] added
Aug 15 17:45:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e771e6-a68f-43cb-8a69-4bdc1f0480a2]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[397252fa-2102-4ba9-8f26-313f39400965]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcAPjBES {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcAPjBES" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0384229-a0d7-47c0-b7d0-2695885d20fe]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcAPjBES'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0935b460-560e-4441-b6ea-c505d2a876b5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb94e50-06aa-4e82-a099-4fb14d0769fb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-110699a7-1f77-4ff9-95b3-c1b8dcd65223 req-13a47383-9c0a-43be-bf4e-8135fadbf319 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received event network-changed-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-110699a7-1f77-4ff9-95b3-c1b8dcd65223 req-13a47383-9c0a-43be-bf4e-8135fadbf319 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Refreshing instance network info cache due to event network-changed-ec54f1b8-2099-4439-99f9-ab21931a1530. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-110699a7-1f77-4ff9-95b3-c1b8dcd65223 req-13a47383-9c0a-43be-bf4e-8135fadbf319 service nova] Acquiring lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-110699a7-1f77-4ff9-95b3-c1b8dcd65223 req-13a47383-9c0a-43be-bf4e-8135fadbf319 service nova] Acquired lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.network.neutron [req-110699a7-1f77-4ff9-95b3-c1b8dcd65223 req-13a47383-9c0a-43be-bf4e-8135fadbf319 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Refreshing network info cache for port ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4fb7c5-66a9-473d-a7e9-3b2323043cdf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559, portal: 172.16.0.220,3260]
Aug 15 17:45:21 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c355ee-0e72-4a53-b05d-cc5ebf2d489b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2aa5f2-9b58-4413-956d-b776bb7aa309]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1977aa-a7ed-4f24-a4e0-5f82e3bf708c]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcAPjBES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] No VIF found with MAC fa:16:3e:91:3e:b4, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.network.neutron [req-110699a7-1f77-4ff9-95b3-c1b8dcd65223 req-13a47383-9c0a-43be-bf4e-8135fadbf319 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updated VIF entry in instance network info cache for port ec54f1b8-2099-4439-99f9-ab21931a1530. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG nova.network.neutron [req-110699a7-1f77-4ff9-95b3-c1b8dcd65223 req-13a47383-9c0a-43be-bf4e-8135fadbf319 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updating instance_info_cache with network_info: [{"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-110699a7-1f77-4ff9-95b3-c1b8dcd65223 req-13a47383-9c0a-43be-bf4e-8135fadbf319 service nova] Releasing lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Snapshot image upload complete
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:22 user nova-compute[73007]: INFO nova.compute.manager [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Shelve offloading
Aug 15 17:45:22 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance destroyed successfully.
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquired lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.neutron [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== connect_volume: return (2875ms) {'type': 'block', 'scsi_wwn': '23035306464366666', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035306464366666', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:f9,bridge_name='br-int',has_traffic_filtering=True,id=5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6,network=Network(0de346cf-f36f-4dcc-ace9-2ffedb421f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b71bb57-eb') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:c9,bridge_name='br-int',has_traffic_filtering=True,id=b52b824d-c6b2-4297-ad8c-76c3b1eee05b,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb52b824d-c6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=04ba3529-e558-43a9-b673-ca64d4313656,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ba3529-e5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=1f69add6-12dc-45a8-adbf-80da2c6332b5,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f69add6-12') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:85:42,bridge_name='br-int',has_traffic_filtering=True,id=c5f777ec-67fa-4a19-87bf-1cc734b9376e,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f777ec-67') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9e:a1,bridge_name='br-int',has_traffic_filtering=True,id=7fde4098-19fb-4c28-98ad-1261432f29a7,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fde4098-19') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=6da276e6-e821-4371-b057-10a96c54117c,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da276e6-e8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lazy-loading 'pci_devices' on Instance uuid f7fc8ce3-8caa-49b7-9a76-601016e3cf31 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:45:22 user nova-compute[73007]:   <uuid>f7fc8ce3-8caa-49b7-9a76-601016e3cf31</uuid>
Aug 15 17:45:22 user nova-compute[73007]:   <name>instance-0000000a</name>
Aug 15 17:45:22 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:45:22 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:45:22 user nova-compute[73007]:   <metadata>
Aug 15 17:45:22 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:45:22 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:45:22 user nova-compute[73007]:       <nova:name>tempest-device-tagging-server-153306664</nova:name>
Aug 15 17:45:22 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:45:16</nova:creationTime>
Aug 15 17:45:22 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:45:22 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:45:22 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:45:22 user nova-compute[73007]:       <nova:owner>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:user uuid="c461e8e715e744c9b0afeef8adb05dc3">tempest-TaggedBootDevicesTest_v242-89734460-project-member</nova:user>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:project uuid="5c9eb31865ff4bde98721c68030bc231">tempest-TaggedBootDevicesTest_v242-89734460</nova:project>
Aug 15 17:45:22 user nova-compute[73007]:       </nova:owner>
Aug 15 17:45:22 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:45:22 user nova-compute[73007]:       <nova:ports>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:port uuid="5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6">
Aug 15 17:45:22 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 17:45:22 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:port uuid="b52b824d-c6b2-4297-ad8c-76c3b1eee05b">
Aug 15 17:45:22 user nova-compute[73007]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Aug 15 17:45:22 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:port uuid="04ba3529-e558-43a9-b673-ca64d4313656">
Aug 15 17:45:22 user nova-compute[73007]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Aug 15 17:45:22 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:port uuid="1f69add6-12dc-45a8-adbf-80da2c6332b5">
Aug 15 17:45:22 user nova-compute[73007]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Aug 15 17:45:22 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:port uuid="c5f777ec-67fa-4a19-87bf-1cc734b9376e">
Aug 15 17:45:22 user nova-compute[73007]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Aug 15 17:45:22 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:port uuid="7fde4098-19fb-4c28-98ad-1261432f29a7">
Aug 15 17:45:22 user nova-compute[73007]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 17:45:22 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:22 user nova-compute[73007]:         <nova:port uuid="6da276e6-e821-4371-b057-10a96c54117c">
Aug 15 17:45:22 user nova-compute[73007]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 17:45:22 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:22 user nova-compute[73007]:       </nova:ports>
Aug 15 17:45:22 user nova-compute[73007]:     </nova:instance>
Aug 15 17:45:22 user nova-compute[73007]:   </metadata>
Aug 15 17:45:22 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:45:22 user nova-compute[73007]:     <system>
Aug 15 17:45:22 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:45:22 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:45:22 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:45:22 user nova-compute[73007]:       <entry name="serial">f7fc8ce3-8caa-49b7-9a76-601016e3cf31</entry>
Aug 15 17:45:22 user nova-compute[73007]:       <entry name="uuid">f7fc8ce3-8caa-49b7-9a76-601016e3cf31</entry>
Aug 15 17:45:22 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:45:22 user nova-compute[73007]:     </system>
Aug 15 17:45:22 user nova-compute[73007]:   </sysinfo>
Aug 15 17:45:22 user nova-compute[73007]:   <os>
Aug 15 17:45:22 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:45:22 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:45:22 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:45:22 user nova-compute[73007]:   </os>
Aug 15 17:45:22 user nova-compute[73007]:   <features>
Aug 15 17:45:22 user nova-compute[73007]:     <acpi/>
Aug 15 17:45:22 user nova-compute[73007]:     <apic/>
Aug 15 17:45:22 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:45:22 user nova-compute[73007]:   </features>
Aug 15 17:45:22 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:45:22 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:45:22 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:45:22 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:45:22 user nova-compute[73007]:   </clock>
Aug 15 17:45:22 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:45:22 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:45:22 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:45:22 user nova-compute[73007]:   </cpu>
Aug 15 17:45:22 user nova-compute[73007]:   <devices>
Aug 15 17:45:22 user nova-compute[73007]:     <disk type="file" device="cdrom">
Aug 15 17:45:22 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 17:45:22 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/f7fc8ce3-8caa-49b7-9a76-601016e3cf31/disk.config"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="hda" bus="ide"/>
Aug 15 17:45:22 user nova-compute[73007]:     </disk>
Aug 15 17:45:22 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:45:22 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:22 user nova-compute[73007]:       <source dev="/dev/sdb"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <serial>fd22e707-b7fb-458c-ad5d-219854d13f6e</serial>
Aug 15 17:45:22 user nova-compute[73007]:     </disk>
Aug 15 17:45:22 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:45:22 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:22 user nova-compute[73007]:       <source dev="/dev/sdc"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <serial>c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04</serial>
Aug 15 17:45:22 user nova-compute[73007]:     </disk>
Aug 15 17:45:22 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:45:22 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:22 user nova-compute[73007]:       <source dev="/dev/sde"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="vdc" bus="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <serial>04da325e-2248-4e39-88df-629822283559</serial>
Aug 15 17:45:22 user nova-compute[73007]:     </disk>
Aug 15 17:45:22 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:22 user nova-compute[73007]:       <mac address="fa:16:3e:16:d7:f9"/>
Aug 15 17:45:22 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="tap5b71bb57-eb"/>
Aug 15 17:45:22 user nova-compute[73007]:     </interface>
Aug 15 17:45:22 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:22 user nova-compute[73007]:       <mac address="fa:16:3e:2d:3d:c9"/>
Aug 15 17:45:22 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="tapb52b824d-c6"/>
Aug 15 17:45:22 user nova-compute[73007]:     </interface>
Aug 15 17:45:22 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:22 user nova-compute[73007]:       <mac address="fa:16:3e:7b:b4:15"/>
Aug 15 17:45:22 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="tap04ba3529-e5"/>
Aug 15 17:45:22 user nova-compute[73007]:     </interface>
Aug 15 17:45:22 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:22 user nova-compute[73007]:       <mac address="fa:16:3e:4a:6b:f6"/>
Aug 15 17:45:22 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="tap1f69add6-12"/>
Aug 15 17:45:22 user nova-compute[73007]:     </interface>
Aug 15 17:45:22 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:22 user nova-compute[73007]:       <mac address="fa:16:3e:c6:85:42"/>
Aug 15 17:45:22 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="tapc5f777ec-67"/>
Aug 15 17:45:22 user nova-compute[73007]:     </interface>
Aug 15 17:45:22 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:22 user nova-compute[73007]:       <mac address="fa:16:3e:ba:9e:a1"/>
Aug 15 17:45:22 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="tap7fde4098-19"/>
Aug 15 17:45:22 user nova-compute[73007]:     </interface>
Aug 15 17:45:22 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:22 user nova-compute[73007]:       <mac address="fa:16:3e:9d:9f:c2"/>
Aug 15 17:45:22 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:22 user nova-compute[73007]:       <target dev="tap6da276e6-e8"/>
Aug 15 17:45:22 user nova-compute[73007]:     </interface>
Aug 15 17:45:22 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:45:22 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/f7fc8ce3-8caa-49b7-9a76-601016e3cf31/console.log" append="off"/>
Aug 15 17:45:22 user nova-compute[73007]:     </serial>
Aug 15 17:45:22 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:45:22 user nova-compute[73007]:     <video>
Aug 15 17:45:22 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:22 user nova-compute[73007]:     </video>
Aug 15 17:45:22 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:45:22 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:45:22 user nova-compute[73007]:     </rng>
Aug 15 17:45:22 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:45:22 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:45:22 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:45:22 user nova-compute[73007]:     </memballoon>
Aug 15 17:45:22 user nova-compute[73007]:   </devices>
Aug 15 17:45:22 user nova-compute[73007]: </domain>
Aug 15 17:45:22 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:f9,bridge_name='br-int',has_traffic_filtering=True,id=5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6,network=Network(0de346cf-f36f-4dcc-ace9-2ffedb421f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b71bb57-eb') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:f9,bridge_name='br-int',has_traffic_filtering=True,id=5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6,network=Network(0de346cf-f36f-4dcc-ace9-2ffedb421f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b71bb57-eb') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b71bb57-eb, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b71bb57-eb, col_values=(('external_ids', {'iface-id': '5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:d7:f9', 'vm-uuid': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: INFO os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:f9,bridge_name='br-int',has_traffic_filtering=True,id=5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6,network=Network(0de346cf-f36f-4dcc-ace9-2ffedb421f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b71bb57-eb')
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:c9,bridge_name='br-int',has_traffic_filtering=True,id=b52b824d-c6b2-4297-ad8c-76c3b1eee05b,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb52b824d-c6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:c9,bridge_name='br-int',has_traffic_filtering=True,id=b52b824d-c6b2-4297-ad8c-76c3b1eee05b,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb52b824d-c6') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb52b824d-c6, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb52b824d-c6, col_values=(('external_ids', {'iface-id': 'b52b824d-c6b2-4297-ad8c-76c3b1eee05b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:3d:c9', 'vm-uuid': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:22 user nova-compute[73007]: INFO os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:c9,bridge_name='br-int',has_traffic_filtering=True,id=b52b824d-c6b2-4297-ad8c-76c3b1eee05b,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb52b824d-c6')
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=04ba3529-e558-43a9-b673-ca64d4313656,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ba3529-e5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=04ba3529-e558-43a9-b673-ca64d4313656,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ba3529-e5') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ba3529-e5, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04ba3529-e5, col_values=(('external_ids', {'iface-id': '04ba3529-e558-43a9-b673-ca64d4313656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b4:15', 'vm-uuid': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: INFO os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=04ba3529-e558-43a9-b673-ca64d4313656,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ba3529-e5')
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=1f69add6-12dc-45a8-adbf-80da2c6332b5,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f69add6-12') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=1f69add6-12dc-45a8-adbf-80da2c6332b5,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f69add6-12') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f69add6-12, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f69add6-12, col_values=(('external_ids', {'iface-id': '1f69add6-12dc-45a8-adbf-80da2c6332b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:6b:f6', 'vm-uuid': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: INFO os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=1f69add6-12dc-45a8-adbf-80da2c6332b5,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f69add6-12')
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:85:42,bridge_name='br-int',has_traffic_filtering=True,id=c5f777ec-67fa-4a19-87bf-1cc734b9376e,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f777ec-67') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:85:42,bridge_name='br-int',has_traffic_filtering=True,id=c5f777ec-67fa-4a19-87bf-1cc734b9376e,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f777ec-67') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5f777ec-67, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5f777ec-67, col_values=(('external_ids', {'iface-id': 'c5f777ec-67fa-4a19-87bf-1cc734b9376e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:85:42', 'vm-uuid': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: INFO os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:85:42,bridge_name='br-int',has_traffic_filtering=True,id=c5f777ec-67fa-4a19-87bf-1cc734b9376e,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f777ec-67')
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9e:a1,bridge_name='br-int',has_traffic_filtering=True,id=7fde4098-19fb-4c28-98ad-1261432f29a7,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fde4098-19') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9e:a1,bridge_name='br-int',has_traffic_filtering=True,id=7fde4098-19fb-4c28-98ad-1261432f29a7,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fde4098-19') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fde4098-19, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7fde4098-19, col_values=(('external_ids', {'iface-id': '7fde4098-19fb-4c28-98ad-1261432f29a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:9e:a1', 'vm-uuid': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: INFO os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9e:a1,bridge_name='br-int',has_traffic_filtering=True,id=7fde4098-19fb-4c28-98ad-1261432f29a7,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fde4098-19')
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=6da276e6-e821-4371-b057-10a96c54117c,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da276e6-e8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=6da276e6-e821-4371-b057-10a96c54117c,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da276e6-e8') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6da276e6-e8, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6da276e6-e8, col_values=(('external_ids', {'iface-id': '6da276e6-e821-4371-b057-10a96c54117c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:9f:c2', 'vm-uuid': 'f7fc8ce3-8caa-49b7-9a76-601016e3cf31'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:23 user nova-compute[73007]: INFO os_vif [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=6da276e6-e821-4371-b057-10a96c54117c,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da276e6-e8')
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.network.neutron [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] No BDM found with device name hda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] No VIF found with MAC fa:16:3e:16:d7:f9, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] No VIF found with MAC fa:16:3e:c6:85:42, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:23 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Using config drive
Aug 15 17:45:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Releasing lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:23 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Creating config drive at /opt/stack/data/nova/instances/f7fc8ce3-8caa-49b7-9a76-601016e3cf31/disk.config
Aug 15 17:45:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f7fc8ce3-8caa-49b7-9a76-601016e3cf31/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnhf48d2j {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f7fc8ce3-8caa-49b7-9a76-601016e3cf31/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnhf48d2j" returned: 0 in 0.069s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance destroyed successfully.
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'resources' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-808387531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-808387531',id=2,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiWEFDUTizVa6mi6X2e8otnDTG491szA8E97zyePRTalDLnNNs2ZAC8znJJ0grfy7VMp8BwtMHD/veSKaeDPORLqU4usx4qvYLND4S2EsVvZAWztlqq8rgYjlGoxNrIVQ==',key_name='tempest-keypair-21307621',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-p93ff0q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member',shelved_at='2023-08-15T17:45:22.176512',shelved_host='user',shelved_image_id='2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=a82e6742-fe31-4693-8db5-50dc97f6072c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG os_vif [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf68e4b-10, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-5713977c-cf01-4ad8-a23b-6b50b3133382 req-5c2aa2b1-37f0-4d27-869a-51a9bee3e97c service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-changed-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-5713977c-cf01-4ad8-a23b-6b50b3133382 req-5c2aa2b1-37f0-4d27-869a-51a9bee3e97c service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Refreshing instance network info cache due to event network-changed-ddf68e4b-1015-4964-9b62-d41585fd04fc. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5713977c-cf01-4ad8-a23b-6b50b3133382 req-5c2aa2b1-37f0-4d27-869a-51a9bee3e97c service nova] Acquiring lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5713977c-cf01-4ad8-a23b-6b50b3133382 req-5c2aa2b1-37f0-4d27-869a-51a9bee3e97c service nova] Acquired lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.network.neutron [req-5713977c-cf01-4ad8-a23b-6b50b3133382 req-5c2aa2b1-37f0-4d27-869a-51a9bee3e97c service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Refreshing network info cache for port ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:24 user nova-compute[73007]: INFO os_vif [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10')
Aug 15 17:45:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Deleting instance files /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c_del
Aug 15 17:45:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Deletion of /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c_del complete
Aug 15 17:45:24 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Deleted allocations for instance a82e6742-fe31-4693-8db5-50dc97f6072c
Aug 15 17:45:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'numa_topology' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.network.neutron [req-5713977c-cf01-4ad8-a23b-6b50b3133382 req-5c2aa2b1-37f0-4d27-869a-51a9bee3e97c service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updated VIF entry in instance network info cache for port ddf68e4b-1015-4964-9b62-d41585fd04fc. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG nova.network.neutron [req-5713977c-cf01-4ad8-a23b-6b50b3133382 req-5c2aa2b1-37f0-4d27-869a-51a9bee3e97c service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapddf68e4b-10", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5713977c-cf01-4ad8-a23b-6b50b3133382 req-5c2aa2b1-37f0-4d27-869a-51a9bee3e97c service nova] Releasing lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30481c8b-025b-4948-9f1d-543f9d3a8761 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.437s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-7f1e0acf-6831-40ba-b19b-601af7d94e9c req-52bd5623-41ec-4b5d-9c11-405de45679a1 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f1e0acf-6831-40ba-b19b-601af7d94e9c req-52bd5623-41ec-4b5d-9c11-405de45679a1 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f1e0acf-6831-40ba-b19b-601af7d94e9c req-52bd5623-41ec-4b5d-9c11-405de45679a1 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f1e0acf-6831-40ba-b19b-601af7d94e9c req-52bd5623-41ec-4b5d-9c11-405de45679a1 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-7f1e0acf-6831-40ba-b19b-601af7d94e9c req-52bd5623-41ec-4b5d-9c11-405de45679a1 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:25 user nova-compute[73007]: WARNING nova.compute.manager [req-7f1e0acf-6831-40ba-b19b-601af7d94e9c req-52bd5623-41ec-4b5d-9c11-405de45679a1 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 for instance with vm_state building and task_state spawning.
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-645da06f-cc54-4b68-987d-4db2cf703099 req-d4ab9bce-e174-494a-b771-f50526f4fd9f service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-645da06f-cc54-4b68-987d-4db2cf703099 req-d4ab9bce-e174-494a-b771-f50526f4fd9f service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-645da06f-cc54-4b68-987d-4db2cf703099 req-d4ab9bce-e174-494a-b771-f50526f4fd9f service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-645da06f-cc54-4b68-987d-4db2cf703099 req-d4ab9bce-e174-494a-b771-f50526f4fd9f service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-645da06f-cc54-4b68-987d-4db2cf703099 req-d4ab9bce-e174-494a-b771-f50526f4fd9f service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:26 user nova-compute[73007]: WARNING nova.compute.manager [req-645da06f-cc54-4b68-987d-4db2cf703099 req-d4ab9bce-e174-494a-b771-f50526f4fd9f service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 for instance with vm_state building and task_state spawning.
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-580ccb58-b5ad-4901-bfbc-d59fde7d0eae req-05a859e6-7857-4d34-a196-46ccc4c52f27 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-580ccb58-b5ad-4901-bfbc-d59fde7d0eae req-05a859e6-7857-4d34-a196-46ccc4c52f27 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-580ccb58-b5ad-4901-bfbc-d59fde7d0eae req-05a859e6-7857-4d34-a196-46ccc4c52f27 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-580ccb58-b5ad-4901-bfbc-d59fde7d0eae req-05a859e6-7857-4d34-a196-46ccc4c52f27 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-580ccb58-b5ad-4901-bfbc-d59fde7d0eae req-05a859e6-7857-4d34-a196-46ccc4c52f27 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:26 user nova-compute[73007]: WARNING nova.compute.manager [req-580ccb58-b5ad-4901-bfbc-d59fde7d0eae req-05a859e6-7857-4d34-a196-46ccc4c52f27 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e for instance with vm_state building and task_state spawning.
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:27 user nova-compute[73007]: WARNING nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 for instance with vm_state building and task_state spawning.
Aug 15 17:45:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:27 user nova-compute[73007]: WARNING nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b for instance with vm_state building and task_state spawning.
Aug 15 17:45:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:27 user nova-compute[73007]: WARNING nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b for instance with vm_state building and task_state spawning.
Aug 15 17:45:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:27 user nova-compute[73007]: WARNING nova.compute.manager [req-4cf50a48-c34f-43ca-9ca3-d4b3d14cd426 req-ea31bd99-bf1a-40b9-bb95-deb2a7e1575e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 for instance with vm_state building and task_state spawning.
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:28 user nova-compute[73007]: WARNING nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 for instance with vm_state building and task_state spawning.
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:28 user nova-compute[73007]: WARNING nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 for instance with vm_state building and task_state spawning.
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:28 user nova-compute[73007]: WARNING nova.compute.manager [req-7f97f869-8cd3-4eb9-ad1c-7d4c63c67190 req-a37df9e2-e3e6-438a-9147-821164a13249 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 for instance with vm_state building and task_state spawning.
Aug 15 17:45:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:28 user nova-compute[73007]: WARNING nova.compute.manager [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e for instance with vm_state building and task_state spawning.
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received event network-changed-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Refreshing instance network info cache due to event network-changed-5c1f8c7c-1c21-453a-a08a-632a7e16d01a. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] Acquiring lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] Acquired lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Refreshing network info cache for port 5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfCPdqSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:28 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:28 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:28 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd2272d-93d9-4c5a-98e4-dcc53be56d22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:28 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fbae80-4315-441b-a3c5-32478c5f5431]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b] added
Aug 15 17:45:28 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[303bdf1f-1c60-41a6-a5df-dec823e0dd0d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3271a5-284e-4d31-9757-8febb7d12897]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfCPdqSs {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfCPdqSs" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf406cbc-0eaf-43eb-a143-e954cce35d4d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfCPdqSs'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f90c4c-3954-4769-943c-5146da2a7075]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff39a9a-7094-46ba-a32a-b2ce6858d03a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aa52dd-1539-4442-bfd4-1b090a62a56d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b, portal: 172.16.0.220,3260]
Aug 15 17:45:29 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5d80ac-77d8-4d43-bc48-822a4f7f986d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adbdbc7-5982-46c3-80c7-37da882976e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:29 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e4c3d-55e6-4215-98e6-13cc169b292b]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfCPdqSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-029b42f6-b72e-46da-b6f7-d0ca884f4dcf tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.095s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.objects.instance [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lazy-loading 'flavor' on Instance uuid 06651cc4-57ab-440f-8fb8-5be64b7441f3 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:29 user nova-compute[73007]: WARNING nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 for instance with vm_state building and task_state spawning.
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:29 user nova-compute[73007]: WARNING nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c for instance with vm_state building and task_state spawning.
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:29 user nova-compute[73007]: WARNING nova.compute.manager [req-c0a7268e-776a-4513-9779-08c3d91f765f req-33e2c2cf-0552-436a-a618-eb6221b659dc service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c for instance with vm_state building and task_state spawning.
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Updated VIF entry in instance network info cache for port 5c1f8c7c-1c21-453a-a08a-632a7e16d01a. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Updating instance_info_cache with network_info: [{"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121529.7506948, f7fc8ce3-8caa-49b7-9a76-601016e3cf31 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:29 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] VM Resumed (Lifecycle Event)
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bc30e42a-23c5-42d1-ba67-e673df56b851 req-07e2fec0-a831-4986-b98c-c13c4fae80eb service nova] Releasing lock "refresh_cache-06651cc4-57ab-440f-8fb8-5be64b7441f3" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:29 user nova-compute[73007]: INFO nova.compute.manager [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Attaching volume 921eca7d-9b37-43b7-9118-9c5406d29293 to /dev/vdb
Aug 15 17:45:29 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance spawned successfully.
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:45:29 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121529.75422, f7fc8ce3-8caa-49b7-9a76-601016e3cf31 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:29 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] VM Started (Lifecycle Event)
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:45:29 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:45:29 user nova-compute[73007]: DEBUG os_brick.utils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: INFO nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Took 13.22 seconds to spawn the instance on the hypervisor.
Aug 15 17:45:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d17017-2d35-4a11-99b4-830581534b93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[224991da-0015-43e3-bccb-71b8c5b18375]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7e5041-cf31-47f2-b1ab-bdb729159044]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92c7f05-6fb5-4eec-a80b-b0c1cd727fcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:30 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[463b5609-61ca-4576-9eb7-bfd6565797a9]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG os_brick.utils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Updating existing volume attachment record: 1d6d768a-04a7-4de9-a5cb-c69b7a8449b7 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:30 user nova-compute[73007]: INFO nova.compute.manager [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Took 47.33 seconds to build instance.
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7b6d5057-47ee-410f-be9b-171bc2351817 tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.435s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:30 user nova-compute[73007]: INFO nova.compute.manager [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Terminating instance
Aug 15 17:45:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23262343236653361', 'path': '/dev/sdf'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262343236653361', 'path': '/dev/sdf'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.objects.instance [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:45:30 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:30 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 17:45:30 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:30 user nova-compute[73007]:   <serial>b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b</serial>
Aug 15 17:45:30 user nova-compute[73007]: </disk>
Aug 15 17:45:30 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-29d34667-05f0-4e7f-8ff8-e326edbdefea req-03783b5e-9f48-4006-8f62-aa9decb9ab07 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received event network-vif-unplugged-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-29d34667-05f0-4e7f-8ff8-e326edbdefea req-03783b5e-9f48-4006-8f62-aa9decb9ab07 service nova] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-29d34667-05f0-4e7f-8ff8-e326edbdefea req-03783b5e-9f48-4006-8f62-aa9decb9ab07 service nova] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-29d34667-05f0-4e7f-8ff8-e326edbdefea req-03783b5e-9f48-4006-8f62-aa9decb9ab07 service nova] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-29d34667-05f0-4e7f-8ff8-e326edbdefea req-03783b5e-9f48-4006-8f62-aa9decb9ab07 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] No waiting events found dispatching network-vif-unplugged-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-29d34667-05f0-4e7f-8ff8-e326edbdefea req-03783b5e-9f48-4006-8f62-aa9decb9ab07 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received event network-vif-unplugged-238f4b21-1dbe-4870-8282-cc0c11449862 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No VIF found with MAC fa:16:3e:54:6d:12, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Instance destroyed successfully.
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.objects.instance [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lazy-loading 'resources' on Instance uuid 1a098861-c387-4883-9d2c-e69ad9a7760a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1295434145',display_name='tempest-DeleteServersTestJSON-server-1295434145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1295434145',id=1,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ead6fc5ea8ef44a185d73923e9d50208',ramdisk_id='',reservation_id='r-ww1h92d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-235019230',owner_user_name='tempest-DeleteServersTestJSON-235019230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:43:33Z,user_data=None,user_id='ec7a834c29d64d0daedb7d6dc62d7315',uuid=1a098861-c387-4883-9d2c-e69ad9a7760a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Converting VIF {"id": "238f4b21-1dbe-4870-8282-cc0c11449862", "address": "fa:16:3e:91:3e:b4", "network": {"id": "39470a92-679f-4036-b7f1-d4e220ec70da", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-226404995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead6fc5ea8ef44a185d73923e9d50208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f4b21-1d", "ovs_interfaceid": "238f4b21-1dbe-4870-8282-cc0c11449862", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:3e:b4,bridge_name='br-int',has_traffic_filtering=True,id=238f4b21-1dbe-4870-8282-cc0c11449862,network=Network(39470a92-679f-4036-b7f1-d4e220ec70da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f4b21-1d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_vif [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:3e:b4,bridge_name='br-int',has_traffic_filtering=True,id=238f4b21-1dbe-4870-8282-cc0c11449862,network=Network(39470a92-679f-4036-b7f1-d4e220ec70da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f4b21-1d') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap238f4b21-1d, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:31 user nova-compute[73007]: INFO os_vif [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:3e:b4,bridge_name='br-int',has_traffic_filtering=True,id=238f4b21-1dbe-4870-8282-cc0c11449862,network=Network(39470a92-679f-4036-b7f1-d4e220ec70da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f4b21-1d')
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHslTWfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:31 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c630e4c-14cf-4597-9df2-00932dfd86a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50f5e50-cd1d-45db-8ef8-bb678bdbb88e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:31 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:31 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:31 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:31 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:31 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:31 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:31 user nova-compute[73007]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 (non-flash)
Aug 15 17:45:31 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:31 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:31 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1164bbb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0dc797-8583-4bcf-81f6-80301a333f46]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2286a31d-9aa0-4d63-a60a-c02b20bcc8d3]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c2de45-be1c-4b24-8ce8-db46c6c53d68]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[230969e5-65d0-49f5-b7f2-ff1eaf4957be]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f115e24-d4a5-4bed-9d2b-1efdb24f90ec]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[12484924-402a-4d7a-94c1-b423e23cf315]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4, portal: 172.16.0.220,3260]
Aug 15 17:45:31 user nova-compute[73007]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:31 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bca645-fac2-42c5-9d1d-b23e4082c2b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[449773aa-c8c3-4d1a-a610-458ad459f60a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] <== disconnect_volume: return (330ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:45:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Deleting instance files /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a_del
Aug 15 17:45:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Deletion of /opt/stack/data/nova/instances/1a098861-c387-4883-9d2c-e69ad9a7760a_del complete
Aug 15 17:45:31 user nova-compute[73007]: INFO nova.compute.manager [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPnHkcZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:31 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:31 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:31 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[46367415-976c-4ceb-a9fb-7e4abe3e1738]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:31 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2300be-1a0c-48f4-a48b-85b2959b3c0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff] added
Aug 15 17:45:31 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a078feac-c9a6-4021-9ad8-c01db9be3018]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f0449-ef0e-4bc1-9118-d5b03f183a5e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPnHkcZT {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPnHkcZT" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[28744307-f1d7-497a-9722-3a6b2dde3b5d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LPnHkcZT'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4b5dcf-c7d7-448e-ae07-b18aa86a167c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df2e745-4f44-4482-afc2-7cd0e8e89867]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcc9489-4276-45ff-b3cb-42b37dfae70f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260]
Aug 15 17:45:32 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b74fc8-3731-423f-a7bc-119e7ac82b51]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cd983de2-4388-42f0-b7c2-a7f33a8aedac tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.150s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea1e9b8-f48f-462b-acf0-50d69e9cb17f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:32 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e23d463-cab4-4987-99bb-ccf09b5843b7]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:32 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Took 0.79 seconds to deallocate network for instance.
Aug 15 17:45:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-e233e909-10f3-46df-b5f5-6905558aa508 req-54ba0b1c-3101-4912-a58a-7078c24284e0 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received event network-vif-deleted-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:32 user nova-compute[73007]: INFO nova.compute.manager [req-e233e909-10f3-46df-b5f5-6905558aa508 req-54ba0b1c-3101-4912-a58a-7078c24284e0 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Neutron deleted interface 238f4b21-1dbe-4870-8282-cc0c11449862; detaching it from the instance and deleting it from the info cache
Aug 15 17:45:32 user nova-compute[73007]: DEBUG nova.network.neutron [req-e233e909-10f3-46df-b5f5-6905558aa508 req-54ba0b1c-3101-4912-a58a-7078c24284e0 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-e233e909-10f3-46df-b5f5-6905558aa508 req-54ba0b1c-3101-4912-a58a-7078c24284e0 service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Detach interface failed, port_id=238f4b21-1dbe-4870-8282-cc0c11449862, reason: Instance 1a098861-c387-4883-9d2c-e69ad9a7760a could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-6228fef0-ed58-4d0c-84fc-758e98f33f35 req-182810d1-55cc-4f45-b494-e8dd6814c45f service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received event network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6228fef0-ed58-4d0c-84fc-758e98f33f35 req-182810d1-55cc-4f45-b494-e8dd6814c45f service nova] Acquiring lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6228fef0-ed58-4d0c-84fc-758e98f33f35 req-182810d1-55cc-4f45-b494-e8dd6814c45f service nova] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6228fef0-ed58-4d0c-84fc-758e98f33f35 req-182810d1-55cc-4f45-b494-e8dd6814c45f service nova] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-6228fef0-ed58-4d0c-84fc-758e98f33f35 req-182810d1-55cc-4f45-b494-e8dd6814c45f service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] No waiting events found dispatching network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:32 user nova-compute[73007]: WARNING nova.compute.manager [req-6228fef0-ed58-4d0c-84fc-758e98f33f35 req-182810d1-55cc-4f45-b494-e8dd6814c45f service nova] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Received unexpected event network-vif-plugged-238f4b21-1dbe-4870-8282-cc0c11449862 for instance with vm_state active and task_state deleting.
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:45:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Creating image(s)
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Ensure instance console log exists: /opt/stack/data/nova/instances/e90005bb-24fc-4f17-9189-50b8ebd906ad/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Start _get_guest_xml network_info=[{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWUjKZRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e90005bb-24fc-4f17-9189-50b8ebd906ad', 'attached_at': '', 'detached_at': '', 'volume_id': '87980b2a-6193-4ef5-bd17-070e51a10764', 'serial': '87980b2a-6193-4ef5-bd17-070e51a10764'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '0c1f79f5-2bf1-4a0f-a430-e9128a876499', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfSPsLEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e90005bb-24fc-4f17-9189-50b8ebd906ad', 'attached_at': '', 'detached_at': '', 'volume_id': '7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0', 'serial': '7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'd6aad76a-899e-4a5c-bae9-636068e5711b', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veLWcTkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e90005bb-24fc-4f17-9189-50b8ebd906ad', 'attached_at': '', 'detached_at': '', 'volume_id': '1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5', 'serial': '1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '86898145-e5fc-4ff0-b624-156057ef4aed', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:45:33 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:45:33 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWUjKZRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:33 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPnHkcZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26566323562343031', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566323562343031', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.125s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:33 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:33 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7318fa38-80e8-4837-9acc-d459b5d61fc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:33 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'flavor' on Instance uuid 31637822-05e9-4762-b3b3-2bc6e49efb6e {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:45:33 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:33 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:45:33 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:33 user nova-compute[73007]:   <serial>71574eb8-e7fd-402a-8b17-9d8fee4997ff</serial>
Aug 15 17:45:33 user nova-compute[73007]: </disk>
Aug 15 17:45:33 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.053s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1298b2-5f9f-4c5d-aad8-2b36ad00ccba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764] added
Aug 15 17:45:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0f631-f9bf-4bd0-9d3d-794a404c0c0c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c5eec-1c8c-493f-b4d8-2d900c2e8c73]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWUjKZRx {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWUjKZRx" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca60524-c962-4b6c-b0dd-e9ba24d83b8a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWUjKZRx'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b836fc17-d334-44af-bd39-140fc96cd9db]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3848a582-cebc-4455-8664-be58b9ab40b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:33 user nova-compute[73007]: INFO nova.compute.manager [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Attaching volume b2c44454-ae41-4ea4-95f4-9f4255693490 to /dev/vdb
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121518.5769973, a82e6742-fe31-4693-8db5-50dc97f6072c => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:33 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] VM Stopped (Lifecycle Event)
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9566cc8-48d0-46f2-94f1-b92ef8463d77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764, portal: 172.16.0.220,3260]
Aug 15 17:45:33 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c8af76ff-c372-4208-9f6e-6bfb73a67220 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b12a9-dba7-4ca6-a2a0-271e8adaf786]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: INFO nova.compute.manager [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Took 1.14 seconds to detach 1 volumes for instance.
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaa3b7b-a465-4af5-a3d9-bbdf0a61d034]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:33 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[197e2c7c-5f74-4e18-80c9-552453d0206b]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWUjKZRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.utils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9610d830-8e50-47ea-871b-ac6806f3f4d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4241a7a4-48bb-4807-806f-7020559fb3c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[80187282-0d39-4c24-8941-75cad5d16910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[448128a9-7974-41b8-b478-003576607e4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:33 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71232db-745b-4cb3-8668-14afc0e85982]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG os_brick.utils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updating existing volume attachment record: 14b3786c-b3ef-45db-b434-7e21629f28eb {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No VIF found with MAC fa:16:3e:4c:f4:0a, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-22712dbb-7048-4dbd-b74f-60dc01035e4b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.730s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:34 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Deleted allocations for instance 1a098861-c387-4883-9d2c-e69ad9a7760a
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-382132a7-11cb-42cc-8d18-03a4e9ed9eaa tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-382132a7-11cb-42cc-8d18-03a4e9ed9eaa tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-382132a7-11cb-42cc-8d18-03a4e9ed9eaa tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-382132a7-11cb-42cc-8d18-03a4e9ed9eaa tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73007) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.objects.instance [None req-382132a7-11cb-42cc-8d18-03a4e9ed9eaa tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-693c8690-8a35-4409-9b7a-9c68ccf32bad tempest-DeleteServersTestJSON-235019230 tempest-DeleteServersTestJSON-235019230-project-member] Lock "1a098861-c387-4883-9d2c-e69ad9a7760a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.114s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== connect_volume: return (1588ms) {'type': 'block', 'scsi_wwn': '26161653861633235', 'path': '/dev/sdg'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161653861633235', 'path': '/dev/sdg'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfSPsLEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:34 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:34 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:34 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ca801-d0f8-43fa-84ed-9c533e81e86f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:34 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-9ed27b04-74b3-4868-93d8-319221c6eb1c req-b0d00ae3-859d-4ad3-acab-c334faa2d78c service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9ed27b04-74b3-4868-93d8-319221c6eb1c req-b0d00ae3-859d-4ad3-acab-c334faa2d78c service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9ed27b04-74b3-4868-93d8-319221c6eb1c req-b0d00ae3-859d-4ad3-acab-c334faa2d78c service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9ed27b04-74b3-4868-93d8-319221c6eb1c req-b0d00ae3-859d-4ad3-acab-c334faa2d78c service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-9ed27b04-74b3-4868-93d8-319221c6eb1c req-b0d00ae3-859d-4ad3-acab-c334faa2d78c service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:34 user nova-compute[73007]: WARNING nova.compute.manager [req-9ed27b04-74b3-4868-93d8-319221c6eb1c req-b0d00ae3-859d-4ad3-acab-c334faa2d78c service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state active and task_state powering-off.
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e66bf-2083-48df-87da-a14b56abff84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0] added
Aug 15 17:45:34 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3833e296-b454-428e-afce-216b9b851667]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848c042-b2a0-4743-8c8e-5d992207c120]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfSPsLEK {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zfSPsLEK" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6d05c-dc4d-46bd-a314-b13c8cda2e0c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zfSPsLEK'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dc3db7-f068-4484-9d22-f3d936378eed]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0d67fa-4000-4666-ad29-e58bb17fac0e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:34 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:34 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:34 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[16606d64-1454-41e6-bebc-77ab1b1a3d3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0, portal: 172.16.0.220,3260]
Aug 15 17:45:35 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2e4939-37e6-49b7-8663-e6c335aa45c5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e405bbd4-ebf8-4a0d-bf20-228dccb9c82a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:35 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3775a8c5-ab80-4d1a-81d7-569924556247]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfSPsLEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance destroyed successfully.
Aug 15 17:45:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-382132a7-11cb-42cc-8d18-03a4e9ed9eaa tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-382132a7-11cb-42cc-8d18-03a4e9ed9eaa tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.962s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "0320a429-4c17-4337-a3c4-e6e806cf5305" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:45:35 user nova-compute[73007]: INFO nova.compute.claims [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Claim successful on node user
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23338666262393762', 'path': '/dev/sdh'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338666262393762', 'path': '/dev/sdh'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.network.neutron [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:45:36 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:45:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veLWcTkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:36 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:36 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:36 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d6e8b-62a9-4731-86ec-80341da62a21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:36 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[721ea109-effc-4064-a08b-b7e8324aae08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5] added
Aug 15 17:45:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.policy [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82906484a46f4ad0be9a602aec2affb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa702dd2884da4b28a84db913819b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3950d27-9c19-4c66-ad04-67b364d72368]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8caaa4-3c31-4a47-b4dc-b52c8a33df46]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veLWcTkx {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veLWcTkx" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bf4eb1-b72a-4445-8969-dbe2a5107bf6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'veLWcTkx'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b492ac9b-67ec-46fc-bb06-7e469a20a4d6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:45:36 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Creating image(s)
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "/opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "/opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "/opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ed69a5-9594-4925-807c-4da2b03c913b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[08309d39-7323-4410-9a61-5ff3d274ff39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5, portal: 172.16.0.220,3260]
Aug 15 17:45:36 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a377a1c-9fbd-42a7-a563-5a8ac74a6975]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d25630-52a4-4380-af21-749f4167fb6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9718ba-ea29-4ec4-88f3-683cec6c2dbd]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veLWcTkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.223s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-5c2ee5a1-ee1d-464a-a4c4-660cca8fc1c9 req-e598b65d-bbb7-4a38-97cc-533b8c98fa67 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5c2ee5a1-ee1d-464a-a4c4-660cca8fc1c9 req-e598b65d-bbb7-4a38-97cc-533b8c98fa67 service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5c2ee5a1-ee1d-464a-a4c4-660cca8fc1c9 req-e598b65d-bbb7-4a38-97cc-533b8c98fa67 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5c2ee5a1-ee1d-464a-a4c4-660cca8fc1c9 req-e598b65d-bbb7-4a38-97cc-533b8c98fa67 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-5c2ee5a1-ee1d-464a-a4c4-660cca8fc1c9 req-e598b65d-bbb7-4a38-97cc-533b8c98fa67 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:36 user nova-compute[73007]: WARNING nova.compute.manager [req-5c2ee5a1-ee1d-464a-a4c4-660cca8fc1c9 req-e598b65d-bbb7-4a38-97cc-533b8c98fa67 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state stopped and task_state None.
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.224s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk 1073741824" returned: 0 in 0.053s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.neutron [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Successfully created port: 1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Cannot resize image /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.objects.instance [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'migration_context' on Instance uuid 0320a429-4c17-4337-a3c4-e6e806cf5305 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Ensure instance console log exists: /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26237366630636235', 'path': '/dev/sdi'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237366630636235', 'path': '/dev/sdi'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:64:16,bridge_name='br-int',has_traffic_filtering=True,id=512fb710-a869-4764-aabc-a5589e500850,network=Network(2d52b81f-ab6c-47d0-86a0-62cb22357d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap512fb710-a8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3d:f0,bridge_name='br-int',has_traffic_filtering=True,id=c2ed06db-22e0-4601-a79a-fce4edb9d325,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2ed06db-22') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fe:6a,bridge_name='br-int',has_traffic_filtering=True,id=e9359e36-f5a8-4f88-8375-2979cc99fa3a,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9359e36-f5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ad:05,bridge_name='br-int',has_traffic_filtering=True,id=95359884-3e57-4e19-b56c-4ce0720f9d9b,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95359884-3e') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a9:b0,bridge_name='br-int',has_traffic_filtering=True,id=db8630a0-4d10-4051-9849-12f968c27580,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8630a0-4d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:47,bridge_name='br-int',has_traffic_filtering=True,id=f2dc89bb-161d-4512-a9b4-56c6f1156d93,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dc89bb-16') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c0:35,bridge_name='br-int',has_traffic_filtering=True,id=7ec98d55-c39e-4aa1-9616-03f4d44bfb09,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec98d55-c3') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lazy-loading 'pci_devices' on Instance uuid e90005bb-24fc-4f17-9189-50b8ebd906ad {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:45:37 user nova-compute[73007]:   <uuid>e90005bb-24fc-4f17-9189-50b8ebd906ad</uuid>
Aug 15 17:45:37 user nova-compute[73007]:   <name>instance-0000000c</name>
Aug 15 17:45:37 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:45:37 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:45:37 user nova-compute[73007]:   <metadata>
Aug 15 17:45:37 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:45:37 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:45:37 user nova-compute[73007]:       <nova:name>tempest-device-tagging-server-650407706</nova:name>
Aug 15 17:45:37 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:45:33</nova:creationTime>
Aug 15 17:45:37 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:45:37 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:45:37 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:45:37 user nova-compute[73007]:       <nova:owner>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:user uuid="f59c9aec5ab24c6188ddf21c5af35d6c">tempest-TaggedBootDevicesTest-2121200936-project-member</nova:user>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:project uuid="677e7d9c21cd4f6fa9df0b9249060855">tempest-TaggedBootDevicesTest-2121200936</nova:project>
Aug 15 17:45:37 user nova-compute[73007]:       </nova:owner>
Aug 15 17:45:37 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:45:37 user nova-compute[73007]:       <nova:ports>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:port uuid="512fb710-a869-4764-aabc-a5589e500850">
Aug 15 17:45:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 17:45:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:port uuid="c2ed06db-22e0-4601-a79a-fce4edb9d325">
Aug 15 17:45:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Aug 15 17:45:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:port uuid="e9359e36-f5a8-4f88-8375-2979cc99fa3a">
Aug 15 17:45:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.1.1.133" ipVersion="4"/>
Aug 15 17:45:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:port uuid="95359884-3e57-4e19-b56c-4ce0720f9d9b">
Aug 15 17:45:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Aug 15 17:45:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:port uuid="db8630a0-4d10-4051-9849-12f968c27580">
Aug 15 17:45:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Aug 15 17:45:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:port uuid="f2dc89bb-161d-4512-a9b4-56c6f1156d93">
Aug 15 17:45:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 17:45:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:37 user nova-compute[73007]:         <nova:port uuid="7ec98d55-c39e-4aa1-9616-03f4d44bfb09">
Aug 15 17:45:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 17:45:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:37 user nova-compute[73007]:       </nova:ports>
Aug 15 17:45:37 user nova-compute[73007]:     </nova:instance>
Aug 15 17:45:37 user nova-compute[73007]:   </metadata>
Aug 15 17:45:37 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:45:37 user nova-compute[73007]:     <system>
Aug 15 17:45:37 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:45:37 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:45:37 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:45:37 user nova-compute[73007]:       <entry name="serial">e90005bb-24fc-4f17-9189-50b8ebd906ad</entry>
Aug 15 17:45:37 user nova-compute[73007]:       <entry name="uuid">e90005bb-24fc-4f17-9189-50b8ebd906ad</entry>
Aug 15 17:45:37 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:45:37 user nova-compute[73007]:     </system>
Aug 15 17:45:37 user nova-compute[73007]:   </sysinfo>
Aug 15 17:45:37 user nova-compute[73007]:   <os>
Aug 15 17:45:37 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:45:37 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:45:37 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:45:37 user nova-compute[73007]:   </os>
Aug 15 17:45:37 user nova-compute[73007]:   <features>
Aug 15 17:45:37 user nova-compute[73007]:     <acpi/>
Aug 15 17:45:37 user nova-compute[73007]:     <apic/>
Aug 15 17:45:37 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:45:37 user nova-compute[73007]:   </features>
Aug 15 17:45:37 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:45:37 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:45:37 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:45:37 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:45:37 user nova-compute[73007]:   </clock>
Aug 15 17:45:37 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:45:37 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:45:37 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:45:37 user nova-compute[73007]:   </cpu>
Aug 15 17:45:37 user nova-compute[73007]:   <devices>
Aug 15 17:45:37 user nova-compute[73007]:     <disk type="file" device="cdrom">
Aug 15 17:45:37 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 17:45:37 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/e90005bb-24fc-4f17-9189-50b8ebd906ad/disk.config"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="hda" bus="ide"/>
Aug 15 17:45:37 user nova-compute[73007]:     </disk>
Aug 15 17:45:37 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:45:37 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:37 user nova-compute[73007]:       <source dev="/dev/sdg"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <serial>87980b2a-6193-4ef5-bd17-070e51a10764</serial>
Aug 15 17:45:37 user nova-compute[73007]:     </disk>
Aug 15 17:45:37 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:45:37 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:37 user nova-compute[73007]:       <source dev="/dev/sdh"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <serial>7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0</serial>
Aug 15 17:45:37 user nova-compute[73007]:     </disk>
Aug 15 17:45:37 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:45:37 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:37 user nova-compute[73007]:       <source dev="/dev/sdi"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="vdc" bus="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <serial>1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5</serial>
Aug 15 17:45:37 user nova-compute[73007]:     </disk>
Aug 15 17:45:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:37 user nova-compute[73007]:       <mac address="fa:16:3e:13:64:16"/>
Aug 15 17:45:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="tap512fb710-a8"/>
Aug 15 17:45:37 user nova-compute[73007]:     </interface>
Aug 15 17:45:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:37 user nova-compute[73007]:       <mac address="fa:16:3e:9b:3d:f0"/>
Aug 15 17:45:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="tapc2ed06db-22"/>
Aug 15 17:45:37 user nova-compute[73007]:     </interface>
Aug 15 17:45:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:37 user nova-compute[73007]:       <mac address="fa:16:3e:b7:fe:6a"/>
Aug 15 17:45:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="tape9359e36-f5"/>
Aug 15 17:45:37 user nova-compute[73007]:     </interface>
Aug 15 17:45:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:37 user nova-compute[73007]:       <mac address="fa:16:3e:4f:ad:05"/>
Aug 15 17:45:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="tap95359884-3e"/>
Aug 15 17:45:37 user nova-compute[73007]:     </interface>
Aug 15 17:45:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:37 user nova-compute[73007]:       <mac address="fa:16:3e:26:a9:b0"/>
Aug 15 17:45:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="tapdb8630a0-4d"/>
Aug 15 17:45:37 user nova-compute[73007]:     </interface>
Aug 15 17:45:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:37 user nova-compute[73007]:       <mac address="fa:16:3e:93:f3:47"/>
Aug 15 17:45:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="tapf2dc89bb-16"/>
Aug 15 17:45:37 user nova-compute[73007]:     </interface>
Aug 15 17:45:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:37 user nova-compute[73007]:       <mac address="fa:16:3e:eb:c0:35"/>
Aug 15 17:45:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:37 user nova-compute[73007]:       <target dev="tap7ec98d55-c3"/>
Aug 15 17:45:37 user nova-compute[73007]:     </interface>
Aug 15 17:45:37 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:45:37 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/e90005bb-24fc-4f17-9189-50b8ebd906ad/console.log" append="off"/>
Aug 15 17:45:37 user nova-compute[73007]:     </serial>
Aug 15 17:45:37 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:45:37 user nova-compute[73007]:     <video>
Aug 15 17:45:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:37 user nova-compute[73007]:     </video>
Aug 15 17:45:37 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:45:37 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:45:37 user nova-compute[73007]:     </rng>
Aug 15 17:45:37 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:45:37 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:45:37 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:45:37 user nova-compute[73007]:     </memballoon>
Aug 15 17:45:37 user nova-compute[73007]:   </devices>
Aug 15 17:45:37 user nova-compute[73007]: </domain>
Aug 15 17:45:37 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:64:16,bridge_name='br-int',has_traffic_filtering=True,id=512fb710-a869-4764-aabc-a5589e500850,network=Network(2d52b81f-ab6c-47d0-86a0-62cb22357d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap512fb710-a8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:64:16,bridge_name='br-int',has_traffic_filtering=True,id=512fb710-a869-4764-aabc-a5589e500850,network=Network(2d52b81f-ab6c-47d0-86a0-62cb22357d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap512fb710-a8') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap512fb710-a8, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap512fb710-a8, col_values=(('external_ids', {'iface-id': '512fb710-a869-4764-aabc-a5589e500850', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:64:16', 'vm-uuid': 'e90005bb-24fc-4f17-9189-50b8ebd906ad'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: INFO os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:64:16,bridge_name='br-int',has_traffic_filtering=True,id=512fb710-a869-4764-aabc-a5589e500850,network=Network(2d52b81f-ab6c-47d0-86a0-62cb22357d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap512fb710-a8')
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3d:f0,bridge_name='br-int',has_traffic_filtering=True,id=c2ed06db-22e0-4601-a79a-fce4edb9d325,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2ed06db-22') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3d:f0,bridge_name='br-int',has_traffic_filtering=True,id=c2ed06db-22e0-4601-a79a-fce4edb9d325,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2ed06db-22') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2ed06db-22, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2ed06db-22, col_values=(('external_ids', {'iface-id': 'c2ed06db-22e0-4601-a79a-fce4edb9d325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:3d:f0', 'vm-uuid': 'e90005bb-24fc-4f17-9189-50b8ebd906ad'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: INFO os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3d:f0,bridge_name='br-int',has_traffic_filtering=True,id=c2ed06db-22e0-4601-a79a-fce4edb9d325,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2ed06db-22')
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fe:6a,bridge_name='br-int',has_traffic_filtering=True,id=e9359e36-f5a8-4f88-8375-2979cc99fa3a,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9359e36-f5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fe:6a,bridge_name='br-int',has_traffic_filtering=True,id=e9359e36-f5a8-4f88-8375-2979cc99fa3a,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9359e36-f5') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9359e36-f5, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9359e36-f5, col_values=(('external_ids', {'iface-id': 'e9359e36-f5a8-4f88-8375-2979cc99fa3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:fe:6a', 'vm-uuid': 'e90005bb-24fc-4f17-9189-50b8ebd906ad'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.neutron [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Successfully updated port: 1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:45:37 user nova-compute[73007]: INFO os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fe:6a,bridge_name='br-int',has_traffic_filtering=True,id=e9359e36-f5a8-4f88-8375-2979cc99fa3a,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9359e36-f5')
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ad:05,bridge_name='br-int',has_traffic_filtering=True,id=95359884-3e57-4e19-b56c-4ce0720f9d9b,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95359884-3e') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ad:05,bridge_name='br-int',has_traffic_filtering=True,id=95359884-3e57-4e19-b56c-4ce0720f9d9b,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95359884-3e') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95359884-3e, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95359884-3e, col_values=(('external_ids', {'iface-id': '95359884-3e57-4e19-b56c-4ce0720f9d9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:ad:05', 'vm-uuid': 'e90005bb-24fc-4f17-9189-50b8ebd906ad'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquired lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.neutron [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-b512952b-a267-4159-ab8d-6d440f6a3700 req-b1ff70e7-54de-4827-8509-b84380448d80 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received event network-changed-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-b512952b-a267-4159-ab8d-6d440f6a3700 req-b1ff70e7-54de-4827-8509-b84380448d80 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Refreshing instance network info cache due to event network-changed-1f8e9d05-5a62-464d-b697-2a8210d318b4. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b512952b-a267-4159-ab8d-6d440f6a3700 req-b1ff70e7-54de-4827-8509-b84380448d80 service nova] Acquiring lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: INFO os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ad:05,bridge_name='br-int',has_traffic_filtering=True,id=95359884-3e57-4e19-b56c-4ce0720f9d9b,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95359884-3e')
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a9:b0,bridge_name='br-int',has_traffic_filtering=True,id=db8630a0-4d10-4051-9849-12f968c27580,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8630a0-4d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a9:b0,bridge_name='br-int',has_traffic_filtering=True,id=db8630a0-4d10-4051-9849-12f968c27580,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8630a0-4d') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb8630a0-4d, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb8630a0-4d, col_values=(('external_ids', {'iface-id': 'db8630a0-4d10-4051-9849-12f968c27580', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:a9:b0', 'vm-uuid': 'e90005bb-24fc-4f17-9189-50b8ebd906ad'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.neutron [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: INFO os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a9:b0,bridge_name='br-int',has_traffic_filtering=True,id=db8630a0-4d10-4051-9849-12f968c27580,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8630a0-4d')
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:47,bridge_name='br-int',has_traffic_filtering=True,id=f2dc89bb-161d-4512-a9b4-56c6f1156d93,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dc89bb-16') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:47,bridge_name='br-int',has_traffic_filtering=True,id=f2dc89bb-161d-4512-a9b4-56c6f1156d93,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dc89bb-16') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2dc89bb-16, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2dc89bb-16, col_values=(('external_ids', {'iface-id': 'f2dc89bb-161d-4512-a9b4-56c6f1156d93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:f3:47', 'vm-uuid': 'e90005bb-24fc-4f17-9189-50b8ebd906ad'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:38 user nova-compute[73007]: INFO os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:47,bridge_name='br-int',has_traffic_filtering=True,id=f2dc89bb-161d-4512-a9b4-56c6f1156d93,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dc89bb-16')
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:44:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c0:35,bridge_name='br-int',has_traffic_filtering=True,id=7ec98d55-c39e-4aa1-9616-03f4d44bfb09,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec98d55-c3') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c0:35,bridge_name='br-int',has_traffic_filtering=True,id=7ec98d55-c39e-4aa1-9616-03f4d44bfb09,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec98d55-c3') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ec98d55-c3, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ec98d55-c3, col_values=(('external_ids', {'iface-id': '7ec98d55-c39e-4aa1-9616-03f4d44bfb09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:c0:35', 'vm-uuid': 'e90005bb-24fc-4f17-9189-50b8ebd906ad'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:38 user nova-compute[73007]: INFO os_vif [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c0:35,bridge_name='br-int',has_traffic_filtering=True,id=7ec98d55-c39e-4aa1-9616-03f4d44bfb09,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec98d55-c3')
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.neutron [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Updating instance_info_cache with network_info: [{"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] No BDM found with device name hda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] No VIF found with MAC fa:16:3e:13:64:16, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] No VIF found with MAC fa:16:3e:26:a9:b0, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:38 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Using config drive
Aug 15 17:45:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Releasing lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Instance network_info: |[{"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b512952b-a267-4159-ab8d-6d440f6a3700 req-b1ff70e7-54de-4827-8509-b84380448d80 service nova] Acquired lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-b512952b-a267-4159-ab8d-6d440f6a3700 req-b1ff70e7-54de-4827-8509-b84380448d80 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Refreshing network info cache for port 1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Start _get_guest_xml network_info=[{"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:45:38 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:45:38 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:45:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228364702',display_name='tempest-AttachVolumeNegativeTest-server-1228364702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1228364702',id=13,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdqgngqPeeyp06wghXoKT8b8/K2OWHH/kYbvrD6stGmkHwXG7rR+T1Yuiq1q7jBenMLC3x8cnEGaPKPzinCLPjExNjFM1E4Zz1od2jsC/LN3vqwowrfKmbV8SxLzHp0GQ==',key_name='tempest-keypair-192588234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-1z7l8no0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=0320a429-4c17-4337-a3c4-e6e806cf5305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ee:35,bridge_name='br-int',has_traffic_filtering=True,id=1f8e9d05-5a62-464d-b697-2a8210d318b4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e9d05-5a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.objects.instance [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'pci_devices' on Instance uuid 0320a429-4c17-4337-a3c4-e6e806cf5305 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:45:38 user nova-compute[73007]:   <uuid>0320a429-4c17-4337-a3c4-e6e806cf5305</uuid>
Aug 15 17:45:38 user nova-compute[73007]:   <name>instance-0000000d</name>
Aug 15 17:45:38 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:45:38 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:45:38 user nova-compute[73007]:   <metadata>
Aug 15 17:45:38 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:45:38 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:45:38 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1228364702</nova:name>
Aug 15 17:45:38 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:45:38</nova:creationTime>
Aug 15 17:45:38 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:45:38 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:45:38 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:45:38 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:45:38 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:45:38 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:45:38 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:45:38 user nova-compute[73007]:       <nova:owner>
Aug 15 17:45:38 user nova-compute[73007]:         <nova:user uuid="82906484a46f4ad0be9a602aec2affb6">tempest-AttachVolumeNegativeTest-1698859108-project-member</nova:user>
Aug 15 17:45:38 user nova-compute[73007]:         <nova:project uuid="1bfa702dd2884da4b28a84db913819b6">tempest-AttachVolumeNegativeTest-1698859108</nova:project>
Aug 15 17:45:38 user nova-compute[73007]:       </nova:owner>
Aug 15 17:45:38 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:45:38 user nova-compute[73007]:       <nova:ports>
Aug 15 17:45:38 user nova-compute[73007]:         <nova:port uuid="1f8e9d05-5a62-464d-b697-2a8210d318b4">
Aug 15 17:45:38 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 17:45:38 user nova-compute[73007]:         </nova:port>
Aug 15 17:45:38 user nova-compute[73007]:       </nova:ports>
Aug 15 17:45:38 user nova-compute[73007]:     </nova:instance>
Aug 15 17:45:38 user nova-compute[73007]:   </metadata>
Aug 15 17:45:38 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:45:38 user nova-compute[73007]:     <system>
Aug 15 17:45:38 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:45:38 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:45:38 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:45:38 user nova-compute[73007]:       <entry name="serial">0320a429-4c17-4337-a3c4-e6e806cf5305</entry>
Aug 15 17:45:38 user nova-compute[73007]:       <entry name="uuid">0320a429-4c17-4337-a3c4-e6e806cf5305</entry>
Aug 15 17:45:38 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:45:38 user nova-compute[73007]:     </system>
Aug 15 17:45:38 user nova-compute[73007]:   </sysinfo>
Aug 15 17:45:38 user nova-compute[73007]:   <os>
Aug 15 17:45:38 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:45:38 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:45:38 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:45:38 user nova-compute[73007]:   </os>
Aug 15 17:45:38 user nova-compute[73007]:   <features>
Aug 15 17:45:38 user nova-compute[73007]:     <acpi/>
Aug 15 17:45:38 user nova-compute[73007]:     <apic/>
Aug 15 17:45:38 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:45:38 user nova-compute[73007]:   </features>
Aug 15 17:45:38 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:45:38 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:45:38 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:45:38 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:45:38 user nova-compute[73007]:   </clock>
Aug 15 17:45:38 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:45:38 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:45:38 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:45:38 user nova-compute[73007]:   </cpu>
Aug 15 17:45:38 user nova-compute[73007]:   <devices>
Aug 15 17:45:38 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:45:38 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:45:38 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk"/>
Aug 15 17:45:38 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:45:38 user nova-compute[73007]:     </disk>
Aug 15 17:45:38 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:45:38 user nova-compute[73007]:       <mac address="fa:16:3e:22:ee:35"/>
Aug 15 17:45:38 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:38 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:45:38 user nova-compute[73007]:       <target dev="tap1f8e9d05-5a"/>
Aug 15 17:45:38 user nova-compute[73007]:     </interface>
Aug 15 17:45:38 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:45:38 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/console.log" append="off"/>
Aug 15 17:45:38 user nova-compute[73007]:     </serial>
Aug 15 17:45:38 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:45:38 user nova-compute[73007]:     <video>
Aug 15 17:45:38 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:45:38 user nova-compute[73007]:     </video>
Aug 15 17:45:38 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:45:38 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:45:38 user nova-compute[73007]:     </rng>
Aug 15 17:45:38 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:45:38 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:45:38 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:45:38 user nova-compute[73007]:     </memballoon>
Aug 15 17:45:38 user nova-compute[73007]:   </devices>
Aug 15 17:45:38 user nova-compute[73007]: </domain>
Aug 15 17:45:38 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:45:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228364702',display_name='tempest-AttachVolumeNegativeTest-server-1228364702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1228364702',id=13,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdqgngqPeeyp06wghXoKT8b8/K2OWHH/kYbvrD6stGmkHwXG7rR+T1Yuiq1q7jBenMLC3x8cnEGaPKPzinCLPjExNjFM1E4Zz1od2jsC/LN3vqwowrfKmbV8SxLzHp0GQ==',key_name='tempest-keypair-192588234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-1z7l8no0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=0320a429-4c17-4337-a3c4-e6e806cf5305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ee:35,bridge_name='br-int',has_traffic_filtering=True,id=1f8e9d05-5a62-464d-b697-2a8210d318b4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e9d05-5a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG os_vif [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ee:35,bridge_name='br-int',has_traffic_filtering=True,id=1f8e9d05-5a62-464d-b697-2a8210d318b4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e9d05-5a') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f8e9d05-5a, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f8e9d05-5a, col_values=(('external_ids', {'iface-id': '1f8e9d05-5a62-464d-b697-2a8210d318b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ee:35', 'vm-uuid': '0320a429-4c17-4337-a3c4-e6e806cf5305'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:45:38 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Creating config drive at /opt/stack/data/nova/instances/e90005bb-24fc-4f17-9189-50b8ebd906ad/disk.config
Aug 15 17:45:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e90005bb-24fc-4f17-9189-50b8ebd906ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdnemr8rs {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:38 user nova-compute[73007]: INFO os_vif [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ee:35,bridge_name='br-int',has_traffic_filtering=True,id=1f8e9d05-5a62-464d-b697-2a8210d318b4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e9d05-5a')
Aug 15 17:45:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e90005bb-24fc-4f17-9189-50b8ebd906ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdnemr8rs" returned: 0 in 0.066s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No VIF found with MAC fa:16:3e:22:ee:35, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-b512952b-a267-4159-ab8d-6d440f6a3700 req-b1ff70e7-54de-4827-8509-b84380448d80 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Updated VIF entry in instance network info cache for port 1f8e9d05-5a62-464d-b697-2a8210d318b4. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-b512952b-a267-4159-ab8d-6d440f6a3700 req-b1ff70e7-54de-4827-8509-b84380448d80 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Updating instance_info_cache with network_info: [{"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b512952b-a267-4159-ab8d-6d440f6a3700 req-b1ff70e7-54de-4827-8509-b84380448d80 service nova] Releasing lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-b0b8b418-d8a2-402e-9cdc-664e5b3a70c3 req-96f2e79b-6e59-424a-adef-aacf0caad095 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received event network-changed-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-b0b8b418-d8a2-402e-9cdc-664e5b3a70c3 req-96f2e79b-6e59-424a-adef-aacf0caad095 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Refreshing instance network info cache due to event network-changed-b2809250-71fc-4b44-a58d-ef662a0bc079. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b0b8b418-d8a2-402e-9cdc-664e5b3a70c3 req-96f2e79b-6e59-424a-adef-aacf0caad095 service nova] Acquiring lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b0b8b418-d8a2-402e-9cdc-664e5b3a70c3 req-96f2e79b-6e59-424a-adef-aacf0caad095 service nova] Acquired lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-b0b8b418-d8a2-402e-9cdc-664e5b3a70c3 req-96f2e79b-6e59-424a-adef-aacf0caad095 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Refreshing network info cache for port b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:39 user nova-compute[73007]: DEBUG nova.network.neutron [req-b0b8b418-d8a2-402e-9cdc-664e5b3a70c3 req-96f2e79b-6e59-424a-adef-aacf0caad095 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Updated VIF entry in instance network info cache for port b2809250-71fc-4b44-a58d-ef662a0bc079. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:39 user nova-compute[73007]: DEBUG nova.network.neutron [req-b0b8b418-d8a2-402e-9cdc-664e5b3a70c3 req-96f2e79b-6e59-424a-adef-aacf0caad095 service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Updating instance_info_cache with network_info: [{"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b0b8b418-d8a2-402e-9cdc-664e5b3a70c3 req-96f2e79b-6e59-424a-adef-aacf0caad095 service nova] Releasing lock "refresh_cache-c456a6f0-d0d4-4927-85c9-2db4fde3c96f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-7fdf92c3-0e4d-451f-b4fb-de1ae0d9120b req-27f8b570-d44c-4d09-b3e8-c268954ded42 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7fdf92c3-0e4d-451f-b4fb-de1ae0d9120b req-27f8b570-d44c-4d09-b3e8-c268954ded42 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7fdf92c3-0e4d-451f-b4fb-de1ae0d9120b req-27f8b570-d44c-4d09-b3e8-c268954ded42 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7fdf92c3-0e4d-451f-b4fb-de1ae0d9120b req-27f8b570-d44c-4d09-b3e8-c268954ded42 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-7fdf92c3-0e4d-451f-b4fb-de1ae0d9120b req-27f8b570-d44c-4d09-b3e8-c268954ded42 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:41 user nova-compute[73007]: WARNING nova.compute.manager [req-7fdf92c3-0e4d-451f-b4fb-de1ae0d9120b req-27f8b570-d44c-4d09-b3e8-c268954ded42 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 for instance with vm_state building and task_state spawning.
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-8522bf8d-bd31-433b-ba07-bd2eaf492640 req-2a757946-780b-498c-a3ff-58586de7621c service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received event network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8522bf8d-bd31-433b-ba07-bd2eaf492640 req-2a757946-780b-498c-a3ff-58586de7621c service nova] Acquiring lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8522bf8d-bd31-433b-ba07-bd2eaf492640 req-2a757946-780b-498c-a3ff-58586de7621c service nova] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8522bf8d-bd31-433b-ba07-bd2eaf492640 req-2a757946-780b-498c-a3ff-58586de7621c service nova] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-8522bf8d-bd31-433b-ba07-bd2eaf492640 req-2a757946-780b-498c-a3ff-58586de7621c service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] No waiting events found dispatching network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:41 user nova-compute[73007]: WARNING nova.compute.manager [req-8522bf8d-bd31-433b-ba07-bd2eaf492640 req-2a757946-780b-498c-a3ff-58586de7621c service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received unexpected event network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 for instance with vm_state building and task_state spawning.
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-986504a6-035f-4ff4-829a-8cf20ce0a5e9 req-77d2d464-6032-4db1-b1ce-730ebd180e9a service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-986504a6-035f-4ff4-829a-8cf20ce0a5e9 req-77d2d464-6032-4db1-b1ce-730ebd180e9a service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-986504a6-035f-4ff4-829a-8cf20ce0a5e9 req-77d2d464-6032-4db1-b1ce-730ebd180e9a service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-986504a6-035f-4ff4-829a-8cf20ce0a5e9 req-77d2d464-6032-4db1-b1ce-730ebd180e9a service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-986504a6-035f-4ff4-829a-8cf20ce0a5e9 req-77d2d464-6032-4db1-b1ce-730ebd180e9a service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:42 user nova-compute[73007]: WARNING nova.compute.manager [req-986504a6-035f-4ff4-829a-8cf20ce0a5e9 req-77d2d464-6032-4db1-b1ce-730ebd180e9a service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 for instance with vm_state building and task_state spawning.
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGzdubWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:42 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f0ba03-24d0-4a8d-b796-9137574dec28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:42 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fea5fd6-2a93-4f8d-a4a2-0f9009396c14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293] added
Aug 15 17:45:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c306ef12-a1ea-4b6c-8130-aad4b2dba1f0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b903ecb-e36f-41d6-b9eb-f2ba99c686d8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGzdubWV {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGzdubWV" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[934b5812-d10e-43d3-b324-365c2dfda293]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aGzdubWV'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e818c6-479b-4e88-87b6-2647b1f63814]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0e41be-e7eb-4599-b243-5c348e577458]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --login" returned: 0 in 0.143s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8c816f-d6d5-4b06-b8ef-1091257b7207]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293, portal: 172.16.0.220,3260]
Aug 15 17:45:43 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcbd09d-41f4-4e6d-999d-3cb33f443d4a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2d2747-fdd4-4dc5-b947-28b23fed1847]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.041s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[28324dce-9fc5-48ea-b218-d05173fbcaf2]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGzdubWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:43 user nova-compute[73007]: WARNING nova.compute.manager [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 for instance with vm_state building and task_state spawning.
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:43 user nova-compute[73007]: WARNING nova.compute.manager [req-84357f39-1c07-4ba3-971a-7fe49f4fd59e req-99c97eda-2e0a-491b-a1ae-a24b6d02f996 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 for instance with vm_state building and task_state spawning.
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lazy-loading 'flavor' on Instance uuid c456a6f0-d0d4-4927-85c9-2db4fde3c96f {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lazy-loading 'flavor' on Instance uuid 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: INFO nova.compute.manager [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Attaching volume 4bc4860c-83db-4394-bd80-1a43a400fd3a to /dev/sdc
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received event network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Acquiring lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] No waiting events found dispatching network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:43 user nova-compute[73007]: WARNING nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received unexpected event network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 for instance with vm_state building and task_state spawning.
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:43 user nova-compute[73007]: WARNING nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a for instance with vm_state building and task_state spawning.
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:43 user nova-compute[73007]: WARNING nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a for instance with vm_state building and task_state spawning.
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:43 user nova-compute[73007]: WARNING nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b for instance with vm_state building and task_state spawning.
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:43 user nova-compute[73007]: WARNING nova.compute.manager [req-067ddc5f-ac55-4802-9bd9-35c4480b20f5 req-2bd935df-cf96-4b42-8325-c79221519c77 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b for instance with vm_state building and task_state spawning.
Aug 15 17:45:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.utils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6277538-9c70-4540-a2cc-aec52aa5eabf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[59828a30-4090-45d8-aac9-31b0c4043215]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e062f1a-aa70-410a-9484-3773f2502c0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d267cda-e677-44fd-b2c5-f6d0dc88bed7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:44 user nova-compute[73007]: INFO nova.compute.manager [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Attaching volume 55d61767-e3fb-4c36-bef5-b346e04334e0 to /dev/vdb
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:44 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[11469c1a-a761-406a-9f43-ff0a3a144e33]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.utils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Updating existing volume attachment record: d72b3024-e16d-4a64-81e7-a87b70b306af {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.525s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '26432376133343935', 'path': '/dev/sdj'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432376133343935', 'path': '/dev/sdj'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.utils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.objects.instance [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lazy-loading 'flavor' on Instance uuid 06651cc4-57ab-440f-8fb8-5be64b7441f3 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bfeedd-63aa-4de4-9359-a9976186da75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dba8e3-5702-4a1e-848f-b98d3d11f151]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 17:45:44 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:44 user nova-compute[73007]:   <source dev="/dev/sdj"/>
Aug 15 17:45:44 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:44 user nova-compute[73007]:   <serial>921eca7d-9b37-43b7-9118-9c5406d29293</serial>
Aug 15 17:45:44 user nova-compute[73007]: </disk>
Aug 15 17:45:44 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6f8dae-d8f2-4a55-8a3f-0762451b98e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9857bba-6ae0-4f34-923d-80bf92d04569]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:44 user nova-compute[73007]: WARNING nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 for instance with vm_state building and task_state spawning.
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received event network-changed-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Refreshing instance network info cache due to event network-changed-722e7669-c824-4ee0-97d6-b048c1000c74. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Acquiring lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Acquired lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.network.neutron [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Refreshing network info cache for port 722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:45:44 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:45:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b9774-42d8-441c-b7f6-9d05b29563e7]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG os_brick.utils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Updating existing volume attachment record: cda0df7d-7bbc-4127-b130-64fd33ca774e {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] No VIF found with MAC fa:16:3e:1b:a6:a2, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121545.05919, 0320a429-4c17-4337-a3c4-e6e806cf5305 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:45 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] VM Resumed (Lifecycle Event)
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:45:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Instance spawned successfully.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.network.neutron [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Updated VIF entry in instance network info cache for port 722e7669-c824-4ee0-97d6-b048c1000c74. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.network.neutron [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Updating instance_info_cache with network_info: [{"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Releasing lock "refresh_cache-76bc99a0-7be4-480c-a7b1-11a9a557c645" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:45 user nova-compute[73007]: WARNING nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 for instance with vm_state building and task_state spawning.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:45 user nova-compute[73007]: WARNING nova.compute.manager [req-d6c24b92-1762-480f-baa1-a4eb5fea1f8c req-836df412-5c42-45ad-a7ac-8a64459b050d service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 for instance with vm_state building and task_state spawning.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:45 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121545.0608916, 0320a429-4c17-4337-a3c4-e6e806cf5305 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:45 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] VM Started (Lifecycle Event)
Aug 15 17:45:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:45 user nova-compute[73007]: INFO nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Took 8.81 seconds to spawn the instance on the hypervisor.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:45:45 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:45:45 user nova-compute[73007]: INFO nova.compute.manager [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Took 9.73 seconds to build instance.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eeab30a6-7f54-4ae9-b566-abb0084f981b tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.850s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:45 user nova-compute[73007]: WARNING nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 for instance with vm_state building and task_state spawning.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:45 user nova-compute[73007]: WARNING nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 for instance with vm_state building and task_state spawning.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:45:45 user nova-compute[73007]: WARNING nova.compute.manager [req-fcff6686-9fd6-4458-9ac5-bef42d1d0859 req-e234c7cd-3bac-44f3-a71d-66a310b45581 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 for instance with vm_state building and task_state spawning.
Aug 15 17:45:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121546.1174796, e90005bb-24fc-4f17-9189-50b8ebd906ad => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:46 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] VM Resumed (Lifecycle Event)
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121531.13454, 1a098861-c387-4883-9d2c-e69ad9a7760a => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:46 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] VM Stopped (Lifecycle Event)
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:46 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance spawned successfully.
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-cc24d061-35a1-40d5-9ab2-0fa73a185aca None None] [instance: 1a098861-c387-4883-9d2c-e69ad9a7760a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:45:46 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121546.1179204, e90005bb-24fc-4f17-9189-50b8ebd906ad => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:46 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] VM Started (Lifecycle Event)
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:45:46 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:45:46 user nova-compute[73007]: INFO nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Took 13.31 seconds to spawn the instance on the hypervisor.
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:46 user nova-compute[73007]: INFO nova.compute.manager [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Took 49.75 seconds to build instance.
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f088fe54-ce84-4859-94a4-3e496a1bbcdb tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.865s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaLoIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:46 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:46 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:46 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e11846-3c67-4664-b549-3a405317b13e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:46 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bff880-b8a4-4f98-90c6-1ae03f722b41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490] added
Aug 15 17:45:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a4d4d-1006-4c12-bc88-c997aa2563d3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a596bc-a160-46b5-bb8c-d1e1b711d121]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERaLoIwe {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERaLoIwe" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7770728-88b2-4f7a-bd3d-226ab97c2669]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERaLoIwe'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-04918b91-dd28-4590-b7e4-81e3371a0e93 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.036s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810ea35-f992-4738-8145-a506b3cc7735]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b2a24-b6a5-466e-8591-cc509da9fd53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c493be-01ff-492c-b10c-99d895bb8279]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490, portal: 172.16.0.220,3260]
Aug 15 17:45:46 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a02c879-0288-4df3-a55a-3346c4d08d47]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab904da-3c1c-40c9-ba06-4eb305b0a20f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[deefb3ca-4934-4989-900e-07c05afa3c90]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a5cf3602-0859-4ca6-bea6-e8dcf04af6f8 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] volume_snapshot_create: create_info: {'snapshot_id': '99c8da62-dc69-48b7-821c-df19cc3fe449', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73007) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a5cf3602-0859-4ca6-bea6-e8dcf04af6f8 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] snap xml: <domainsnapshot>
Aug 15 17:45:47 user nova-compute[73007]:   <disks>
Aug 15 17:45:47 user nova-compute[73007]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 15 17:45:47 user nova-compute[73007]:       <source file="/dev/new_file"/>
Aug 15 17:45:47 user nova-compute[73007]:     </disk>
Aug 15 17:45:47 user nova-compute[73007]:     <disk name="vda" snapshot="no"/>
Aug 15 17:45:47 user nova-compute[73007]:   </disks>
Aug 15 17:45:47 user nova-compute[73007]: </domainsnapshot>
Aug 15 17:45:47 user nova-compute[73007]:  {{(pid=73007) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a5cf3602-0859-4ca6-bea6-e8dcf04af6f8 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lazy-loading 'system_metadata' on Instance uuid 06651cc4-57ab-440f-8fb8-5be64b7441f3 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:47 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a5cf3602-0859-4ca6-bea6-e8dcf04af6f8 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [None req-a5cf3602-0859-4ca6-bea6-e8dcf04af6f8 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     rv = execute(f, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     six.reraise(c, e, tb)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     raise value
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     rv = meth(*args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [None req-a5cf3602-0859-4ca6-bea6-e8dcf04af6f8 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     self._volume_snapshot_create(context, instance, guest,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     rv = execute(f, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     six.reraise(c, e, tb)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     raise value
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     rv = meth(*args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] 
Aug 15 17:45:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f32a67a8-327e-42a6-ab34-eedc6f912c4e tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] volume_snapshot_delete: delete_info: {'volume_id': '921eca7d-9b37-43b7-9118-9c5406d29293'} {{(pid=73007) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [None req-f32a67a8-327e-42a6-ab34-eedc6f912c4e tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3]     if delete_info['type'] != 'qcow2':
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] KeyError: 'type'
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [None req-a5cf3602-0859-4ca6-bea6-e8dcf04af6f8 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 99c8da62-dc69-48b7-821c-df19cc3fe449 could not be found.
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 99c8da62-dc69-48b7-821c-df19cc3fe449 could not be found. (HTTP 404) (Request-ID: req-3ccd707b-e0a5-4894-bead-ffe3bbc57b86)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 99c8da62-dc69-48b7-821c-df19cc3fe449 could not be found.
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server [None req-a5cf3602-0859-4ca6-bea6-e8dcf04af6f8 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver [None req-f32a67a8-327e-42a6-ab34-eedc6f912c4e tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-bab61935-9b59-4522-b8f0-7f2e10b97992)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 17:45:47 user nova-compute[73007]: ERROR nova.virt.libvirt.driver 
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server [None req-f32a67a8-327e-42a6-ab34-eedc6f912c4e tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 17:45:47 user nova-compute[73007]: ERROR oslo_messaging.rpc.server 
Aug 15 17:45:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:47 user nova-compute[73007]: INFO nova.compute.manager [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Detaching volume 921eca7d-9b37-43b7-9118-9c5406d29293
Aug 15 17:45:47 user nova-compute[73007]: INFO nova.virt.block_device [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Attempting to driver detach volume 921eca7d-9b37-43b7-9118-9c5406d29293 from mountpoint /dev/vdb
Aug 15 17:45:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Attempting to detach device vdb from instance 06651cc4-57ab-440f-8fb8-5be64b7441f3 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 17:45:47 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:47 user nova-compute[73007]:   <source dev="/dev/sdj"/>
Aug 15 17:45:47 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:47 user nova-compute[73007]:   <serial>921eca7d-9b37-43b7-9118-9c5406d29293</serial>
Aug 15 17:45:47 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:45:47 user nova-compute[73007]: </disk>
Aug 15 17:45:47 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:45:47 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Successfully detached device vdb from instance 06651cc4-57ab-440f-8fb8-5be64b7441f3 from the persistent domain config.
Aug 15 17:45:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06651cc4-57ab-440f-8fb8-5be64b7441f3 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:45:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 17:45:47 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:47 user nova-compute[73007]:   <source dev="/dev/sdj"/>
Aug 15 17:45:47 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:47 user nova-compute[73007]:   <serial>921eca7d-9b37-43b7-9118-9c5406d29293</serial>
Aug 15 17:45:47 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:45:47 user nova-compute[73007]: </disk>
Aug 15 17:45:47 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaLoIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23239306431333465', 'path': '/dev/sdk'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239306431333465', 'path': '/dev/sdk'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'flavor' on Instance uuid 31637822-05e9-4762-b3b3-2bc6e49efb6e {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:45:48 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:48 user nova-compute[73007]:   <source dev="/dev/sdk"/>
Aug 15 17:45:48 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:48 user nova-compute[73007]:   <serial>b2c44454-ae41-4ea4-95f4-9f4255693490</serial>
Aug 15 17:45:48 user nova-compute[73007]: </disk>
Aug 15 17:45:48 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121548.248106, 06651cc4-57ab-440f-8fb8-5be64b7441f3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06651cc4-57ab-440f-8fb8-5be64b7441f3 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:45:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Successfully detached device vdb from instance 06651cc4-57ab-440f-8fb8-5be64b7441f3 from the live domain config.
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGzdubWV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:48 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c959bef-f1c0-4138-b8e9-16aa104c8f93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d5e542-76de-4a73-a37a-a512e1e8fb8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:48 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11625036d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293'): ({'sdj'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Removing single pathed devices sdj {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89d8e8-a1a6-434d-a573-fbd1c15abf5f]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9ef686-b3c0-4cb3-a7a1-53be46251fd9]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Flushing IO for device /dev/sdj {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d6c8e-c320-46ed-9f79-c447ae7e4cf1]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a333397-a043-4f47-8fbc-4960e280d0df]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] SCSI volumes sdj have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bc2c36-ceda-4d5f-bcc8-1bbe6b71e49f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ba6ff1-6321-48e9-9f47-41cdb7960fec]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293, portal: 172.16.0.220,3260]
Aug 15 17:45:48 user nova-compute[73007]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:48 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:921eca7d-9b37-43b7-9118-9c5406d29293 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79fd7f-6bee-4770-ad1b-185548a8d582]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] <== disconnect_volume: return (386ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] No VIF found with MAC fa:16:3e:8e:d9:bc, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lazy-loading 'flavor' on Instance uuid 06651cc4-57ab-440f-8fb8-5be64b7441f3 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ee7722aa-3527-4cfa-8e61-98886205cb82 tempest-VolumesAssistedSnapshotsTest-285901641 tempest-VolumesAssistedSnapshotsTest-285901641-project-admin] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.005s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77c49024-74d4-4662-9982-f4da34e96427 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.151s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:50 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121535.187273, 42c38120-5e1d-4438-a53b-8a188e417c91 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:45:50 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Stopped (Lifecycle Event)
Aug 15 17:45:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-bed67c98-0ae6-4d28-89cf-fa38bf3fbb54 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:45:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-bed67c98-0ae6-4d28-89cf-fa38bf3fbb54 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:45:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:50 user nova-compute[73007]: INFO nova.compute.manager [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Detaching volume b2c44454-ae41-4ea4-95f4-9f4255693490
Aug 15 17:45:50 user nova-compute[73007]: INFO nova.virt.block_device [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Attempting to driver detach volume b2c44454-ae41-4ea4-95f4-9f4255693490 from mountpoint /dev/vdb
Aug 15 17:45:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Attempting to detach device vdb from instance 31637822-05e9-4762-b3b3-2bc6e49efb6e from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:45:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:45:50 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:50 user nova-compute[73007]:   <source dev="/dev/sdk"/>
Aug 15 17:45:50 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:50 user nova-compute[73007]:   <serial>b2c44454-ae41-4ea4-95f4-9f4255693490</serial>
Aug 15 17:45:50 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:45:50 user nova-compute[73007]: </disk>
Aug 15 17:45:50 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:45:50 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Successfully detached device vdb from instance 31637822-05e9-4762-b3b3-2bc6e49efb6e from the persistent domain config.
Aug 15 17:45:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31637822-05e9-4762-b3b3-2bc6e49efb6e from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:45:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:45:50 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:50 user nova-compute[73007]:   <source dev="/dev/sdk"/>
Aug 15 17:45:50 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:50 user nova-compute[73007]:   <serial>b2c44454-ae41-4ea4-95f4-9f4255693490</serial>
Aug 15 17:45:50 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:45:50 user nova-compute[73007]: </disk>
Aug 15 17:45:50 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121551.3705487, 31637822-05e9-4762-b3b3-2bc6e49efb6e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31637822-05e9-4762-b3b3-2bc6e49efb6e {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:45:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Successfully detached device vdb from instance 31637822-05e9-4762-b3b3-2bc6e49efb6e from the live domain config.
Aug 15 17:45:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERaLoIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:51 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be2286-c3fd-48b7-8ea5-d43e145b59e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e55e69c-9216-4b10-8a06-2ad89a5c82fe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:51 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7be7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490'): ({'sdk'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Removing single pathed devices sdk {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[10163866-2c29-4c6d-855d-0f7c4d33e61b]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eba0a0-f406-495a-aa49-1877c8cd0507]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Flushing IO for device /dev/sdk {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[978323f7-66ee-4f77-b74e-b1e8213b0ef9]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.046s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[830efec6-4dbc-45a3-9fcc-0dbbd899404e]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] SCSI volumes sdk have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f39569-47a0-4f87-93eb-c5c640dc102c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8846e4cf-8b85-470e-9adc-85cfcd5410c0]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490, portal: 172.16.0.220,3260]
Aug 15 17:45:51 user nova-compute[73007]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:51 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2c44454-ae41-4ea4-95f4-9f4255693490 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[997f0a6b-f438-437f-aef8-822281d000f6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] <== disconnect_volume: return (404ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:45:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:52 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'flavor' on Instance uuid 31637822-05e9-4762-b3b3-2bc6e49efb6e {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c04f4cf4-8729-4465-8f37-ad297ec579aa tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.009s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmeZRIXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:56 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:56 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:56 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c984b0de-d92d-41cc-adc0-2c3e453dc9b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:56 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4512d0f-f4ba-42d6-ab6b-9eeb370ad231]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a] added
Aug 15 17:45:56 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[88778441-68ee-4dd4-b42b-0e0aad52bf9b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9590e77d-9ab0-477f-bd33-10333388a5c3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WmeZRIXJ {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WmeZRIXJ" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a118be-5e80-4110-b8d4-c579a58bdb61]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WmeZRIXJ'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf83e7c-2f38-4914-8f32-0995a8ccea64]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b830b8fd-b641-4b06-ad4d-9570eecad7bc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[83457918-4a81-4e85-8604-83afc5fc87ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a, portal: 172.16.0.220,3260]
Aug 15 17:45:56 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:56 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b8dceb-52fe-4476-adcc-9b2aab5d89df]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d453856-de19-43cd-8338-24632ab9ed82]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:56 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ec40f8-7d21-4b38-8c7e-ae1067f3bb41]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:45:56 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmeZRIXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26539633334363831', 'path': '/dev/sdj'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539633334363831', 'path': '/dev/sdj'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.948s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:57 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:45:57 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lazy-loading 'flavor' on Instance uuid c456a6f0-d0d4-4927-85c9-2db4fde3c96f {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02cd95c-801e-4816-8c19-70ce6af5aa3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:45:57 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:45:57 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:57 user nova-compute[73007]:   <source dev="/dev/sdj"/>
Aug 15 17:45:57 user nova-compute[73007]:   <target dev="sdc" bus="scsi"/>
Aug 15 17:45:57 user nova-compute[73007]:   <serial>4bc4860c-83db-4394-bd80-1a43a400fd3a</serial>
Aug 15 17:45:57 user nova-compute[73007]:   <address type="drive" controller="0" unit="2"/>
Aug 15 17:45:57 user nova-compute[73007]: </disk>
Aug 15 17:45:57 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d1fcf-c7c1-4d7e-bd2b-46f6e765c987]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0] added
Aug 15 17:45:57 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0518939f-f58d-4905-b278-650aa62c5627]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[862fb3f1-b81f-44f2-b6ae-9748a93d8320]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGZbTlxe {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGZbTlxe" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[562690a4-cf9d-44b9-a565-499448a9ab3e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fGZbTlxe'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac6fd1-8806-4a85-ab00-5d142c1001cd]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed9c6c-d1e2-4ea5-b122-e6129ebab2e2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b9800c-5539-4ca4-8043-191c1388a574]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260]
Aug 15 17:45:57 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260] successful.
Aug 15 17:45:57 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[120886d0-bafc-4a6f-abe2-82693f50ddf5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cea54e-580e-410e-a990-7a6069a5bac9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:45:57 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26fc6c0-5fe7-4b3e-af73-74eecef3bd9e]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:45:57 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] No BDM found with device name sda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] No VIF found with MAC fa:16:3e:39:ff:2a, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c24e9c0c-383e-441e-a3f6-716998980de4 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.400s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] <== connect_volume: return (2318ms) {'type': 'block', 'scsi_wwn': '23638643938316532', 'path': '/dev/sdk'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:45:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638643938316532', 'path': '/dev/sdk'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.objects.instance [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lazy-loading 'flavor' on Instance uuid 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:45:59 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:59 user nova-compute[73007]:   <source dev="/dev/sdk"/>
Aug 15 17:45:59 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:45:59 user nova-compute[73007]:   <serial>55d61767-e3fb-4c36-bef5-b346e04334e0</serial>
Aug 15 17:45:59 user nova-compute[73007]: </disk>
Aug 15 17:45:59 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] No VIF found with MAC fa:16:3e:1c:70:34, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9da420ac-7452-40cd-92ec-24f0674e6045 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.412s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:45:59 user nova-compute[73007]: INFO nova.compute.manager [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Detaching volume 4bc4860c-83db-4394-bd80-1a43a400fd3a
Aug 15 17:45:59 user nova-compute[73007]: INFO nova.virt.block_device [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Attempting to driver detach volume 4bc4860c-83db-4394-bd80-1a43a400fd3a from mountpoint /dev/sdc
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Attempting to detach device sdc from instance c456a6f0-d0d4-4927-85c9-2db4fde3c96f from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:45:59 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:59 user nova-compute[73007]:   <source dev="/dev/sdj"/>
Aug 15 17:45:59 user nova-compute[73007]:   <target dev="sdc" bus="scsi"/>
Aug 15 17:45:59 user nova-compute[73007]:   <serial>4bc4860c-83db-4394-bd80-1a43a400fd3a</serial>
Aug 15 17:45:59 user nova-compute[73007]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 17:45:59 user nova-compute[73007]: </disk>
Aug 15 17:45:59 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:45:59 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Successfully detached device sdc from instance c456a6f0-d0d4-4927-85c9-2db4fde3c96f from the persistent domain config.
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c456a6f0-d0d4-4927-85c9-2db4fde3c96f from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:45:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:45:59 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:45:59 user nova-compute[73007]:   <source dev="/dev/sdj"/>
Aug 15 17:45:59 user nova-compute[73007]:   <target dev="sdc" bus="scsi"/>
Aug 15 17:45:59 user nova-compute[73007]:   <serial>4bc4860c-83db-4394-bd80-1a43a400fd3a</serial>
Aug 15 17:45:59 user nova-compute[73007]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 17:45:59 user nova-compute[73007]: </disk>
Aug 15 17:45:59 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121560.0646782, c456a6f0-d0d4-4927-85c9-2db4fde3c96f => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c456a6f0-d0d4-4927-85c9-2db4fde3c96f {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:46:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Successfully detached device sdc from instance c456a6f0-d0d4-4927-85c9-2db4fde3c96f from the live domain config.
Aug 15 17:46:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WmeZRIXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:00 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a082a5-926b-44fe-83db-0ccbf5ce05e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c3d47e-a74a-4552-92cd-cb10581e966f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7b0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a'): ({'sdj'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Removing single pathed devices sdj {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[51195020-5f34-4fdb-8e85-c86997889dc0]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[286cbb00-9c77-4133-9d4e-72b7d11a2fc4]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Flushing IO for device /dev/sdj {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[719d9b5a-4937-417d-9035-32a15c0f5381]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.065s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a51a83-88e6-4586-b256-6fd0411ef336]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] SCSI volumes sdj have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a314ff-0999-48e7-9b3c-4087411f75d1]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fdb181-2607-4d5e-a129-61d652cf9773]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a, portal: 172.16.0.220,3260]
Aug 15 17:46:00 user nova-compute[73007]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bc4860c-83db-4394-bd80-1a43a400fd3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2429ca44-42f9-4a71-84a7-2e8a4fb3192f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] <== disconnect_volume: return (346ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.utils [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b409c-f97d-4bd9-96e9-f55098ba8c8d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6295eb73-ca85-4baa-bce7-0daaa62f8f34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5075d8-a252-4ceb-8a78-2388c1dddf44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b200465-361d-4482-b587-a061c8725370]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:46:00 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:46:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb1223-ef58-4f7f-8f14-c36994809fd3]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:46:00 user nova-compute[73007]: DEBUG os_brick.utils [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:01 user nova-compute[73007]: INFO nova.compute.manager [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Swapping volume 55d61767-e3fb-4c36-bef5-b346e04334e0 for 3903ae12-9588-4471-99bb-06d53d721829
Aug 15 17:46:01 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lazy-loading 'flavor' on Instance uuid c456a6f0-d0d4-4927-85c9-2db4fde3c96f {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c134608d-0dee-4085-8945-ee81489e39fd tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.796s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:02 user nova-compute[73007]: INFO nova.compute.manager [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Terminating instance
Aug 15 17:46:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-a88dcd0b-bd50-4397-b362-5e2f7df26d7a req-fc345a82-75a9-4369-a0cc-2711869cb61a service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received event network-vif-unplugged-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a88dcd0b-bd50-4397-b362-5e2f7df26d7a req-fc345a82-75a9-4369-a0cc-2711869cb61a service nova] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a88dcd0b-bd50-4397-b362-5e2f7df26d7a req-fc345a82-75a9-4369-a0cc-2711869cb61a service nova] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a88dcd0b-bd50-4397-b362-5e2f7df26d7a req-fc345a82-75a9-4369-a0cc-2711869cb61a service nova] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-a88dcd0b-bd50-4397-b362-5e2f7df26d7a req-fc345a82-75a9-4369-a0cc-2711869cb61a service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] No waiting events found dispatching network-vif-unplugged-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-a88dcd0b-bd50-4397-b362-5e2f7df26d7a req-fc345a82-75a9-4369-a0cc-2711869cb61a service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received event network-vif-unplugged-b2809250-71fc-4b44-a58d-ef662a0bc079 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Instance destroyed successfully.
Aug 15 17:46:02 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lazy-loading 'resources' on Instance uuid c456a6f0-d0d4-4927-85c9-2db4fde3c96f {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-457650173',display_name='tempest-AttachSCSIVolumeTestJSON-server-457650173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-457650173',id=8,image_ref='f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9RJNNfL92NnvPAWf7kIStSh88iL8gfd+K2qEYGeG4qSyV+yzqOCD1yRmiFtcHFa4RJMwVVFPpPlImVs93l9XbhCbXeSNV4qSoFEIC8g4jGrjHvcSnV8mTgFA1Hp9OS1Q==',key_name='tempest-keypair-1140898119',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:44:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ee903cb4cf54edbb46d3d735dd5ee4f',ramdisk_id='',reservation_id='r-atad7kru',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8205c6e-d6ed-468d-9b3f-e6a3d099bdc9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-776031099',owner_user_name='tempest-AttachSCSIVolumeTestJSON-776031099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:44:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1927ba78a2e84bb7b1ba8c3187a62eac',uuid=c456a6f0-d0d4-4927-85c9-2db4fde3c96f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Converting VIF {"id": "b2809250-71fc-4b44-a58d-ef662a0bc079", "address": "fa:16:3e:39:ff:2a", "network": {"id": "0679cb29-1994-47c8-97ea-589eeadfc21f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-817953036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee903cb4cf54edbb46d3d735dd5ee4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2809250-71", "ovs_interfaceid": "b2809250-71fc-4b44-a58d-ef662a0bc079", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:ff:2a,bridge_name='br-int',has_traffic_filtering=True,id=b2809250-71fc-4b44-a58d-ef662a0bc079,network=Network(0679cb29-1994-47c8-97ea-589eeadfc21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2809250-71') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG os_vif [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ff:2a,bridge_name='br-int',has_traffic_filtering=True,id=b2809250-71fc-4b44-a58d-ef662a0bc079,network=Network(0679cb29-1994-47c8-97ea-589eeadfc21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2809250-71') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2809250-71, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:02 user nova-compute[73007]: INFO os_vif [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:ff:2a,bridge_name='br-int',has_traffic_filtering=True,id=b2809250-71fc-4b44-a58d-ef662a0bc079,network=Network(0679cb29-1994-47c8-97ea-589eeadfc21f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2809250-71')
Aug 15 17:46:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Deleting instance files /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f_del
Aug 15 17:46:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Deletion of /opt/stack/data/nova/instances/c456a6f0-d0d4-4927-85c9-2db4fde3c96f_del complete
Aug 15 17:46:03 user nova-compute[73007]: INFO nova.compute.manager [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updating instance_info_cache with network_info: [{"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:46:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:04 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Took 1.12 seconds to deallocate network for instance.
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-ce489238-2014-4478-b6b9-6040c1315918 req-9bf2bb72-6f21-4c17-b236-b97a772d8edb service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received event network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ce489238-2014-4478-b6b9-6040c1315918 req-9bf2bb72-6f21-4c17-b236-b97a772d8edb service nova] Acquiring lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ce489238-2014-4478-b6b9-6040c1315918 req-9bf2bb72-6f21-4c17-b236-b97a772d8edb service nova] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ce489238-2014-4478-b6b9-6040c1315918 req-9bf2bb72-6f21-4c17-b236-b97a772d8edb service nova] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-ce489238-2014-4478-b6b9-6040c1315918 req-9bf2bb72-6f21-4c17-b236-b97a772d8edb service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] No waiting events found dispatching network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:04 user nova-compute[73007]: WARNING nova.compute.manager [req-ce489238-2014-4478-b6b9-6040c1315918 req-9bf2bb72-6f21-4c17-b236-b97a772d8edb service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received unexpected event network-vif-plugged-b2809250-71fc-4b44-a58d-ef662a0bc079 for instance with vm_state deleted and task_state None.
Aug 15 17:46:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-ce489238-2014-4478-b6b9-6040c1315918 req-9bf2bb72-6f21-4c17-b236-b97a772d8edb service nova] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Received event network-vif-deleted-b2809250-71fc-4b44-a58d-ef662a0bc079 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:04 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Deleted allocations for instance c456a6f0-d0d4-4927-85c9-2db4fde3c96f
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a7d31ed-3d9c-42ce-968b-37d35c6e5606 tempest-AttachSCSIVolumeTestJSON-776031099 tempest-AttachSCSIVolumeTestJSON-776031099-project-member] Lock "c456a6f0-d0d4-4927-85c9-2db4fde3c96f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.663s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:07 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:46:07 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7034MB free_disk=25.559986114501953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6b14b5d1-a493-4506-be76-029324a5aadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 31637822-05e9-4762-b3b3-2bc6e49efb6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 06651cc4-57ab-440f-8fb8-5be64b7441f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance f7fc8ce3-8caa-49b7-9a76-601016e3cf31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 92002335-4c3a-4d9b-ba90-f1840c9142b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e90005bb-24fc-4f17-9189-50b8ebd906ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 0320a429-4c17-4337-a3c4-e6e806cf5305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:46:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:08 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:46:08 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:46:08 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:46:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvGFBwsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76bc99a0-7be4-480c-a7b1-11a9a557c645', 'attached_at': '', 'detached_at': '', 'volume_id': '3903ae12-9588-4471-99bb-06d53d721829', 'serial': '3903ae12-9588-4471-99bb-06d53d721829'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '76bc99a0-7be4-480c-a7b1-11a9a557c645', 'attached_at': '', 'detached_at': '', 'volume_id': '55d61767-e3fb-4c36-bef5-b346e04334e0', 'serial'} {{(pid=73007) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvGFBwsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:12 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[363b5754-7766-45e1-a117-5bfdd97e1949]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:46:12 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e41da-f7a1-4f0c-a6dd-50a255c3101e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829] added
Aug 15 17:46:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2e5892-4073-4827-9ee7-4de9a93414ff]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ecb70-4bf0-4735-a5d8-304b4d909538]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvGFBwsx {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JvGFBwsx" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d755e05c-1925-4d19-bbc2-ded024940a01]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JvGFBwsx'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e6b505-85b9-4f89-b709-110012042408]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a814f6-7ea8-4554-8436-99ea7989d29f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d233c-c8ce-4396-89b1-d553b9b84ae5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829, portal: 172.16.0.220,3260]
Aug 15 17:46:12 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3931c534-403e-481a-a895-a5dfa418b0b0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c4bd2d-5a74-4931-b5f1-ef4be32913fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfeed1d-769f-4873-9bd8-aee8e5831ed2]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:46:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:13 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:46:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvGFBwsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:46:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26330303131616532', 'path': '/dev/sdj'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330303131616532', 'path': '/dev/sdj'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:46:13 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lazy-loading 'flavor' on Instance uuid 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 153092096 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 363855872 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 546308096 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 722468864 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 878706688 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 1049624576 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:17 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fa1355-beae-48b4-9771-9d0754755274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c71c73-2ca5-46db-ab5a-67ef8469d684]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c79cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'): ({'sdk'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Removing single pathed devices sdk {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0b7611-c8d4-47f4-ae17-b9bf3354fcd3]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b3e9a-7cf9-4811-a17c-0e09f74f8d06]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Flushing IO for device /dev/sdk {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ac2625-6edf-456b-a07e-437a268a2674]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ce2f62-8a36-4db5-befc-9c98148071b4]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] SCSI volumes sdk have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d34123-2a08-4955-90cb-d4d1265c9ab0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f63597-7ac3-4865-ac3a-c1ab36e1c37c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260]
Aug 15 17:46:17 user nova-compute[73007]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a40d7ff-5b89-42b3-aefd-9d251d48ccee]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] <== disconnect_volume: return (314ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121562.8690093, c456a6f0-d0d4-4927-85c9-2db4fde3c96f => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:46:17 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] VM Stopped (Lifecycle Event)
Aug 15 17:46:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvGFBwsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '76bc99a0-7be4-480c-a7b1-11a9a557c645', 'attached_at': '', 'detached_at': '', 'volume_id': '3903ae12-9588-4471-99bb-06d53d721829', 'serial'} {{(pid=73007) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] swap_volume: removing Cinder connection for volume 55d61767-e3fb-4c36-bef5-b346e04334e0 {{(pid=73007) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd332bd-72f6-414d-a982-2f00b0bb851d None None] [instance: c456a6f0-d0d4-4927-85c9-2db4fde3c96f] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:46:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] swap_volume: Updating volume 55d61767-e3fb-4c36-bef5-b346e04334e0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "JvGFBwsx", "auth_password": "rSClkPctbaxw5Z", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "3903ae12-9588-4471-99bb-06d53d721829"}, "status": "reserved", "instance": "76bc99a0-7be4-480c-a7b1-11a9a557c645", "attached_at": "", "detached_at": "", "volume_id": "3903ae12-9588-4471-99bb-06d53d721829", "serial": "3903ae12-9588-4471-99bb-06d53d721829"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3903ae12-9588-4471-99bb-06d53d721829', 'no_device': None, 'attachment_id': '64910acd-78b0-4391-81ba-f9968da2feb0'} {{(pid=73007) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 17:46:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6f5b02a0-d7cf-4ff7-bf58-910fbbc591ce tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.856s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG os_brick.utils [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c535afd-ad23-4171-a6aa-bdd9ba088359]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0727ec08-6781-40a5-a8f9-f76d4a592758]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6251d3c4-be5b-4ab8-926b-c8adedac4156]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443ad21-5eb6-4255-ab1b-6a6372e532c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:46:19 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:46:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17d120-6a13-47f5-8367-5dc555de49fe]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:46:19 user nova-compute[73007]: DEBUG os_brick.utils [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:19 user nova-compute[73007]: INFO nova.compute.manager [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Swapping volume 3903ae12-9588-4471-99bb-06d53d721829 for 55d61767-e3fb-4c36-bef5-b346e04334e0
Aug 15 17:46:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:46:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:46:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:46:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76bc99a0-7be4-480c-a7b1-11a9a557c645', 'attached_at': '', 'detached_at': '', 'volume_id': '55d61767-e3fb-4c36-bef5-b346e04334e0', 'serial': '55d61767-e3fb-4c36-bef5-b346e04334e0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvGFBwsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '3903ae12-9588-4471-99bb-06d53d721829'}, 'status': 'reserved', 'instance': '76bc99a0-7be4-480c-a7b1-11a9a557c645', 'attached_at': '', 'detached_at': '', 'volume_id': '3903ae12-9588-4471-99bb-06d53d721829', 'serial'} {{(pid=73007) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:29 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:29 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:29 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:46:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd90372e-6d4f-470e-aabc-89e050a19806]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:46:29 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[05006f45-e7dd-42fc-b350-f083c1559d87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0] added
Aug 15 17:46:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e4cf39-1284-4472-9100-b00e7caf8ba0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[78510050-c953-4a2a-a4e0-6bcfd9f9404e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGZbTlxe {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fGZbTlxe" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a314f3-3814-4010-a71d-765ae20b8d93]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fGZbTlxe'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6a811-447d-4b54-9323-e0bed74d0d00]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafa4ec9-75ce-4cf9-90f1-33689f3ebd24]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[856b18b5-84cc-4967-ba9f-37b8a7c297dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260]
Aug 15 17:46:30 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8236829b-2fbe-448a-b3f2-33367604d2d5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd5b55e-8c81-4c91-94c0-4887bed0bc96]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] HCTL ('42', '-', '-', 0) found on session 16 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42274d3-7880-45b6-82fa-504888633da6]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:46:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:46:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:46:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23638643938316532', 'path': '/dev/sdk'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638643938316532', 'path': '/dev/sdk'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:46:31 user nova-compute[73007]: DEBUG nova.objects.instance [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lazy-loading 'flavor' on Instance uuid 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 139460608 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 327155712 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:46:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:46:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:46:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 526385152 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 698351616 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-7ff5d651-c914-44e9-a036-20d1a07c2e6e req-2c19b2b9-1e01-4489-a593-43570a7411b2 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-changed-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-7ff5d651-c914-44e9-a036-20d1a07c2e6e req-2c19b2b9-1e01-4489-a593-43570a7411b2 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing instance network info cache due to event network-changed-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:46:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7ff5d651-c914-44e9-a036-20d1a07c2e6e req-2c19b2b9-1e01-4489-a593-43570a7411b2 service nova] Acquiring lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:46:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7ff5d651-c914-44e9-a036-20d1a07c2e6e req-2c19b2b9-1e01-4489-a593-43570a7411b2 service nova] Acquired lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:46:34 user nova-compute[73007]: DEBUG nova.network.neutron [req-7ff5d651-c914-44e9-a036-20d1a07c2e6e req-2c19b2b9-1e01-4489-a593-43570a7411b2 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Refreshing network info cache for port 5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:46:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 823132160 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 997195776 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-7ff5d651-c914-44e9-a036-20d1a07c2e6e req-2c19b2b9-1e01-4489-a593-43570a7411b2 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updated VIF entry in instance network info cache for port 5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-7ff5d651-c914-44e9-a036-20d1a07c2e6e req-2c19b2b9-1e01-4489-a593-43570a7411b2 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [{"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7ff5d651-c914-44e9-a036-20d1a07c2e6e req-2c19b2b9-1e01-4489-a593-43570a7411b2 service nova] Releasing lock "refresh_cache-f7fc8ce3-8caa-49b7-9a76-601016e3cf31" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JvGFBwsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '3903ae12-9588-4471-99bb-06d53d721829'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:35 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[563adc38-b9d7-4a14-aee0-061ddaa59662]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9af2e-e647-44af-9582-832380bbcc17]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c79ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829'): ({'sdj'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Removing single pathed devices sdj {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[057364d1-fd18-4064-bafd-ad04d285f709]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8027e8c-61df-434e-b81c-34a9fc17f269]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Flushing IO for device /dev/sdj {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ba2fe3-2763-4b86-928d-b4d1ebe56f8d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dddcca4-0814-4ced-af79-5f8da64c760f]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] SCSI volumes sdj have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f2b788-7e95-4425-8398-edd9ad13b1c6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e13089d-d64f-4076-86dc-6780c7f8ba8d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829, portal: 172.16.0.220,3260]
Aug 15 17:46:35 user nova-compute[73007]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903ae12-9588-4471-99bb-06d53d721829 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[98255246-821d-4af3-b102-ef41e329daea]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] <== disconnect_volume: return (357ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '76bc99a0-7be4-480c-a7b1-11a9a557c645', 'attached_at': '', 'detached_at': '', 'volume_id': '55d61767-e3fb-4c36-bef5-b346e04334e0', 'serial'} {{(pid=73007) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 17:46:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] swap_volume: removing Cinder connection for volume 3903ae12-9588-4471-99bb-06d53d721829 {{(pid=73007) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 17:46:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] swap_volume: Updating volume 3903ae12-9588-4471-99bb-06d53d721829 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "fGZbTlxe", "auth_password": "9rtpVOXx7jG5Ce", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "55d61767-e3fb-4c36-bef5-b346e04334e0"}, "status": "reserved", "instance": "76bc99a0-7be4-480c-a7b1-11a9a557c645", "attached_at": "", "detached_at": "", "volume_id": "55d61767-e3fb-4c36-bef5-b346e04334e0", "serial": "55d61767-e3fb-4c36-bef5-b346e04334e0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '55d61767-e3fb-4c36-bef5-b346e04334e0', 'no_device': None, 'attachment_id': '4732da4f-d72f-4409-8de1-7c8b163f07e0'} {{(pid=73007) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 17:46:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-16ecff2a-b11b-4c0b-bb48-38c774e9d13d tempest-TestVolumeSwap-247267900 tempest-TestVolumeSwap-247267900-project-admin] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.215s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:36 user nova-compute[73007]: INFO nova.compute.manager [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Terminating instance
Aug 15 17:46:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0429d14-3169-47f8-8edd-82c0fc2de19e req-0b3baa20-4e30-4e41-941a-fb8bcfd30fe9 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0429d14-3169-47f8-8edd-82c0fc2de19e req-0b3baa20-4e30-4e41-941a-fb8bcfd30fe9 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0429d14-3169-47f8-8edd-82c0fc2de19e req-0b3baa20-4e30-4e41-941a-fb8bcfd30fe9 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0429d14-3169-47f8-8edd-82c0fc2de19e req-0b3baa20-4e30-4e41-941a-fb8bcfd30fe9 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0429d14-3169-47f8-8edd-82c0fc2de19e req-0b3baa20-4e30-4e41-941a-fb8bcfd30fe9 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-unplugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0429d14-3169-47f8-8edd-82c0fc2de19e req-0b3baa20-4e30-4e41-941a-fb8bcfd30fe9 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-2cf54914-129d-471c-9964-1bc447bcc136 req-e7bc89a7-2592-4270-8d5c-7ff0d9a72c73 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2cf54914-129d-471c-9964-1bc447bcc136 req-e7bc89a7-2592-4270-8d5c-7ff0d9a72c73 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2cf54914-129d-471c-9964-1bc447bcc136 req-e7bc89a7-2592-4270-8d5c-7ff0d9a72c73 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2cf54914-129d-471c-9964-1bc447bcc136 req-e7bc89a7-2592-4270-8d5c-7ff0d9a72c73 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-2cf54914-129d-471c-9964-1bc447bcc136 req-e7bc89a7-2592-4270-8d5c-7ff0d9a72c73 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-unplugged-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-2cf54914-129d-471c-9964-1bc447bcc136 req-e7bc89a7-2592-4270-8d5c-7ff0d9a72c73 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-04ba3529-e558-43a9-b673-ca64d4313656 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-145ba557-bb55-4203-81ca-d5fc5da6e69d req-db06ddfb-6610-42b1-8f79-f63f417035c8 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-145ba557-bb55-4203-81ca-d5fc5da6e69d req-db06ddfb-6610-42b1-8f79-f63f417035c8 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-145ba557-bb55-4203-81ca-d5fc5da6e69d req-db06ddfb-6610-42b1-8f79-f63f417035c8 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-145ba557-bb55-4203-81ca-d5fc5da6e69d req-db06ddfb-6610-42b1-8f79-f63f417035c8 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-145ba557-bb55-4203-81ca-d5fc5da6e69d req-db06ddfb-6610-42b1-8f79-f63f417035c8 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-unplugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-145ba557-bb55-4203-81ca-d5fc5da6e69d req-db06ddfb-6610-42b1-8f79-f63f417035c8 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:38 user nova-compute[73007]: INFO nova.compute.manager [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Detaching volume 55d61767-e3fb-4c36-bef5-b346e04334e0
Aug 15 17:46:38 user nova-compute[73007]: INFO nova.virt.block_device [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Attempting to driver detach volume 55d61767-e3fb-4c36-bef5-b346e04334e0 from mountpoint /dev/vdb
Aug 15 17:46:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Attempting to detach device vdb from instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:46:38 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:46:38 user nova-compute[73007]:   <source dev="/dev/sdk"/>
Aug 15 17:46:38 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:46:38 user nova-compute[73007]:   <serial>55d61767-e3fb-4c36-bef5-b346e04334e0</serial>
Aug 15 17:46:38 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:46:38 user nova-compute[73007]: </disk>
Aug 15 17:46:38 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:46:38 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Successfully detached device vdb from instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 from the persistent domain config.
Aug 15 17:46:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:46:38 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:46:38 user nova-compute[73007]:   <source dev="/dev/sdk"/>
Aug 15 17:46:38 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:46:38 user nova-compute[73007]:   <serial>55d61767-e3fb-4c36-bef5-b346e04334e0</serial>
Aug 15 17:46:38 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:46:38 user nova-compute[73007]: </disk>
Aug 15 17:46:38 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121598.9720144, 76bc99a0-7be4-480c-a7b1-11a9a557c645 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:46:38 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Successfully detached device vdb from instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 from the live domain config.
Aug 15 17:46:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fGZbTlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '55d61767-e3fb-4c36-bef5-b346e04334e0'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:38 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:38 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:46:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Instance destroyed successfully.
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lazy-loading 'resources' on Instance uuid f7fc8ce3-8caa-49b7-9a76-601016e3cf31 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[158d879c-9833-4464-ae13-44eb1304264d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:d7:f9,bridge_name='br-int',has_traffic_filtering=True,id=5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6,network=Network(0de346cf-f36f-4dcc-ace9-2ffedb421f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b71bb57-eb') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:d7:f9,bridge_name='br-int',has_traffic_filtering=True,id=5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6,network=Network(0de346cf-f36f-4dcc-ace9-2ffedb421f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b71bb57-eb') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b71bb57-eb, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b11684-1704-4d78-b677-420593b3df8f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7b1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0'): ({'sdk'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Removing single pathed devices sdk {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f3b806-81ee-4d59-ab44-4ca1618ce35e]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed3fb3-5daa-430d-a663-f5318b633a18]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Flushing IO for device /dev/sdk {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: INFO os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:d7:f9,bridge_name='br-int',has_traffic_filtering=True,id=5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6,network=Network(0de346cf-f36f-4dcc-ace9-2ffedb421f18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b71bb57-eb')
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:c9,bridge_name='br-int',has_traffic_filtering=True,id=b52b824d-c6b2-4297-ad8c-76c3b1eee05b,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb52b824d-c6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:c9,bridge_name='br-int',has_traffic_filtering=True,id=b52b824d-c6b2-4297-ad8c-76c3b1eee05b,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb52b824d-c6') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb52b824d-c6, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2496ccf-f014-485c-859b-cac74478d464]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.052s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f471817c-da34-4f65-9578-74329495c7f7]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] SCSI volumes sdk have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: INFO os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:c9,bridge_name='br-int',has_traffic_filtering=True,id=b52b824d-c6b2-4297-ad8c-76c3b1eee05b,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb52b824d-c6')
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=04ba3529-e558-43a9-b673-ca64d4313656,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ba3529-e5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=04ba3529-e558-43a9-b673-ca64d4313656,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ba3529-e5') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ba3529-e5, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bcb140-6964-4212-b91c-9b812b969fe2]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: INFO os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=04ba3529-e558-43a9-b673-ca64d4313656,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04ba3529-e5')
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "address": "fa:16:3e:4a:6b:f6", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f69add6-12", "ovs_interfaceid": "1f69add6-12dc-45a8-adbf-80da2c6332b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=1f69add6-12dc-45a8-adbf-80da2c6332b5,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f69add6-12') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=1f69add6-12dc-45a8-adbf-80da2c6332b5,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f69add6-12') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f69add6-12, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c63c74-673c-46a8-a376-940161c9dc4b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260]
Aug 15 17:46:39 user nova-compute[73007]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:39 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: INFO os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6b:f6,bridge_name='br-int',has_traffic_filtering=True,id=1f69add6-12dc-45a8-adbf-80da2c6332b5,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f69add6-12')
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:85:42,bridge_name='br-int',has_traffic_filtering=True,id=c5f777ec-67fa-4a19-87bf-1cc734b9376e,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f777ec-67') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:85:42,bridge_name='br-int',has_traffic_filtering=True,id=c5f777ec-67fa-4a19-87bf-1cc734b9376e,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f777ec-67') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5f777ec-67, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d61767-e3fb-4c36-bef5-b346e04334e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1c2015-37f3-40f7-b1e0-f39505d03403]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] <== disconnect_volume: return (374ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: INFO os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:85:42,bridge_name='br-int',has_traffic_filtering=True,id=c5f777ec-67fa-4a19-87bf-1cc734b9376e,network=Network(2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f777ec-67')
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9e:a1,bridge_name='br-int',has_traffic_filtering=True,id=7fde4098-19fb-4c28-98ad-1261432f29a7,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fde4098-19') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9e:a1,bridge_name='br-int',has_traffic_filtering=True,id=7fde4098-19fb-4c28-98ad-1261432f29a7,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fde4098-19') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fde4098-19, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: INFO os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:9e:a1,bridge_name='br-int',has_traffic_filtering=True,id=7fde4098-19fb-4c28-98ad-1261432f29a7,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fde4098-19')
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-153306664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-153306664',id=10,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrS1erHA7QLlijuip4xPVFGZ5oghyuUg8MSlDazPaWP/J24jznz0FMMUKh4SZshGvKod9r/DdLW2ukD8ryts7AVGPP0RVfbjPkddfhSadO97ebRq1/N3vZeWXfNHbfG0A==',key_name='tempest-keypair-1810427071',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c9eb31865ff4bde98721c68030bc231',ramdisk_id='',reservation_id='r-e9lk4lgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-89734460',owner_user_name='tempest-TaggedBootDevicesTest_v242-89734460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c461e8e715e744c9b0afeef8adb05dc3',uuid=f7fc8ce3-8caa-49b7-9a76-601016e3cf31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converting VIF {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=6da276e6-e821-4371-b057-10a96c54117c,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da276e6-e8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=6da276e6-e821-4371-b057-10a96c54117c,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da276e6-e8') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6da276e6-e8, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: WARNING nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 for instance with vm_state active and task_state deleting.
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-unplugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: WARNING nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-b52b824d-c6b2-4297-ad8c-76c3b1eee05b for instance with vm_state active and task_state deleting.
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-unplugged-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-7fde4098-19fb-4c28-98ad-1261432f29a7 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: WARNING nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-7fde4098-19fb-4c28-98ad-1261432f29a7 for instance with vm_state active and task_state deleting.
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-unplugged-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-f141d014-d9b1-4e3f-bc52-7f826d54a9b7 req-3168fabe-182e-4d0a-88bd-624281fa0fb7 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-6da276e6-e821-4371-b057-10a96c54117c for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:39 user nova-compute[73007]: INFO os_vif [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:9f:c2,bridge_name='br-int',has_traffic_filtering=True,id=6da276e6-e821-4371-b057-10a96c54117c,network=Network(2ed3ad51-9902-4c7e-9bcc-d32693432776),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6da276e6-e8')
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcAPjBES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:39 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc2496a-8889-401b-835c-dddc849d596d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35fa4f-d560-4263-89d7-4b6a3e77af07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c79dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8e68ad-3a82-4de8-9e40-98d9dd5ccc4c]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9654e9d3-d85f-49d9-a1c0-97c6a8fe4d78]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2e4c80-0d79-4d0d-80e7-7a2c4295fd38]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c367d5a1-5601-4f07-863f-6ffa4519e0d0]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf065ac-c691-43f9-8e1b-b1a6cd68bf3f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d608aaf-0cc6-4d58-bac3-91a278d7bf2e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559, portal: 172.16.0.220,3260]
Aug 15 17:46:39 user nova-compute[73007]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:39 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04da325e-2248-4e39-88df-629822283559 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51defae-606d-414e-b5a9-db0f3200b658]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== disconnect_volume: return (322ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzajxMpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:39 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73852765-bcde-4528-8744-c64ff931d47c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4216d2-4ee2-4044-8c3e-73e967445ddf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:39 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1150701510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04'): ({'sdc'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Removing single pathed devices sdc {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84dc236-598e-4a80-89cf-1bff07203bbc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[126538be-d10d-4861-be09-4c7e0d25d2c6]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Flushing IO for device /dev/sdc {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-c9fca73c-7325-473e-ad3d-2cde05900a30 req-9e5be1b8-8c0a-47da-ba06-5d6fcc571b5e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c9fca73c-7325-473e-ad3d-2cde05900a30 req-9e5be1b8-8c0a-47da-ba06-5d6fcc571b5e service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c9fca73c-7325-473e-ad3d-2cde05900a30 req-9e5be1b8-8c0a-47da-ba06-5d6fcc571b5e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c9fca73c-7325-473e-ad3d-2cde05900a30 req-9e5be1b8-8c0a-47da-ba06-5d6fcc571b5e service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-c9fca73c-7325-473e-ad3d-2cde05900a30 req-9e5be1b8-8c0a-47da-ba06-5d6fcc571b5e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: WARNING nova.compute.manager [req-c9fca73c-7325-473e-ad3d-2cde05900a30 req-9e5be1b8-8c0a-47da-ba06-5d6fcc571b5e service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-c5f777ec-67fa-4a19-87bf-1cc734b9376e for instance with vm_state active and task_state deleting.
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e7d43-c1a1-4a7c-85f8-25a7706f408a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: WARNING nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-04ba3529-e558-43a9-b673-ca64d4313656 for instance with vm_state active and task_state deleting.
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-unplugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-unplugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:39 user nova-compute[73007]: WARNING nova.compute.manager [req-1f04b9b7-29ef-4b8b-8d6f-6bf86b6e7714 req-aa54dac2-66fd-40fb-a098-b53678216d77 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-1f69add6-12dc-45a8-adbf-80da2c6332b5 for instance with vm_state active and task_state deleting.
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79297ee-41d0-4b13-9093-13fe45e04063]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:46:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd1254-a0f0-4924-a6b0-b17d12e9d2cf]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e7953a-bc2a-4e84-b971-753f62e51488]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04, portal: 172.16.0.220,3260]
Aug 15 17:46:40 user nova-compute[73007]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1d90f1d-47ab-4fa8-98ce-dd6cd8609a04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[70471395-a3c8-405a-956d-b48da06ff67f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== disconnect_volume: return (340ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LTatvSkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:40 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61e5d05-3f1c-4a4b-a59c-e736200e4dc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab6ed5e-01e0-48bb-918f-535178a2aaea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:40 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1150701510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af93f13-951e-4dc3-bc56-0b5ce4008270]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG nova.objects.instance [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lazy-loading 'flavor' on Instance uuid 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee720583-1d94-4a81-a4d0-18c5191caf32]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee69e6d4-b89a-4395-8d6b-48c38af23d8d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-221b6acb-57a6-4c9a-808d-e9b87bd98bbb tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.046s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b195f0-7913-4249-844c-4ef8dc0746c1]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeb1cc8-3cc7-424f-8720-c1ec0a66a397]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[708fe08a-e574-4484-bd72-db51c46f9aa8]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e, portal: 172.16.0.220,3260]
Aug 15 17:46:40 user nova-compute[73007]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd22e707-b7fb-458c-ad5d-219854d13f6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdee3bd-b288-409b-81ea-a73976494f81]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] <== disconnect_volume: return (314ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:46:40 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Deleting instance files /opt/stack/data/nova/instances/f7fc8ce3-8caa-49b7-9a76-601016e3cf31_del
Aug 15 17:46:40 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Deletion of /opt/stack/data/nova/instances/f7fc8ce3-8caa-49b7-9a76-601016e3cf31_del complete
Aug 15 17:46:40 user nova-compute[73007]: INFO nova.compute.manager [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Took 3.66 seconds to destroy the instance on the hypervisor.
Aug 15 17:46:40 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:46:40 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:46:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-d75225fc-1831-468d-a503-48ef06727254 req-432f5833-0cb3-486b-b7d2-2a8aaa472a8a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d75225fc-1831-468d-a503-48ef06727254 req-432f5833-0cb3-486b-b7d2-2a8aaa472a8a service nova] Acquiring lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d75225fc-1831-468d-a503-48ef06727254 req-432f5833-0cb3-486b-b7d2-2a8aaa472a8a service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d75225fc-1831-468d-a503-48ef06727254 req-432f5833-0cb3-486b-b7d2-2a8aaa472a8a service nova] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-d75225fc-1831-468d-a503-48ef06727254 req-432f5833-0cb3-486b-b7d2-2a8aaa472a8a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] No waiting events found dispatching network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:41 user nova-compute[73007]: WARNING nova.compute.manager [req-d75225fc-1831-468d-a503-48ef06727254 req-432f5833-0cb3-486b-b7d2-2a8aaa472a8a service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received unexpected event network-vif-plugged-6da276e6-e821-4371-b057-10a96c54117c for instance with vm_state active and task_state deleting.
Aug 15 17:46:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-b7f7f2e0-647b-45eb-b1a4-0d7c5cfe5085 req-c7116ef9-b6b3-4e5a-be9e-b45c1fb460bb service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received event network-changed-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-b7f7f2e0-647b-45eb-b1a4-0d7c5cfe5085 req-c7116ef9-b6b3-4e5a-be9e-b45c1fb460bb service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Refreshing instance network info cache due to event network-changed-1f124901-40ef-497d-9479-7bb22833f3d4. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:46:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b7f7f2e0-647b-45eb-b1a4-0d7c5cfe5085 req-c7116ef9-b6b3-4e5a-be9e-b45c1fb460bb service nova] Acquiring lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:46:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b7f7f2e0-647b-45eb-b1a4-0d7c5cfe5085 req-c7116ef9-b6b3-4e5a-be9e-b45c1fb460bb service nova] Acquired lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:46:42 user nova-compute[73007]: DEBUG nova.network.neutron [req-b7f7f2e0-647b-45eb-b1a4-0d7c5cfe5085 req-c7116ef9-b6b3-4e5a-be9e-b45c1fb460bb service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Refreshing network info cache for port 1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:46:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "66b9060e-47dd-4ac6-9277-501ff800bffa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:42 user nova-compute[73007]: DEBUG nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:46:43 user nova-compute[73007]: INFO nova.compute.claims [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Claim successful on node user
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'flavor' on Instance uuid 92002335-4c3a-4d9b-ba90-f1840c9142b5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Ignoring supplied device name: /dev/vdb
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:43 user nova-compute[73007]: INFO nova.compute.manager [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Attaching volume 1f098273-a558-488d-b3b7-6b8837f2aa71 to /dev/vdb
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.network.neutron [req-b7f7f2e0-647b-45eb-b1a4-0d7c5cfe5085 req-c7116ef9-b6b3-4e5a-be9e-b45c1fb460bb service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Updated VIF entry in instance network info cache for port 1f124901-40ef-497d-9479-7bb22833f3d4. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.network.neutron [req-b7f7f2e0-647b-45eb-b1a4-0d7c5cfe5085 req-c7116ef9-b6b3-4e5a-be9e-b45c1fb460bb service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Updating instance_info_cache with network_info: [{"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG os_brick.utils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b7f7f2e0-647b-45eb-b1a4-0d7c5cfe5085 req-c7116ef9-b6b3-4e5a-be9e-b45c1fb460bb service nova] Releasing lock "refresh_cache-92002335-4c3a-4d9b-ba90-f1840c9142b5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4b5730-0d6d-45ac-a861-42ad16f70f26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-f8f5377e-ff24-4c41-b747-d6b492d40ff0 req-71c6e66f-6841-4c2f-98fe-6d8e61f4c6bd service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-deleted-1f69add6-12dc-45a8-adbf-80da2c6332b5 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:43 user nova-compute[73007]: INFO nova.compute.manager [req-f8f5377e-ff24-4c41-b747-d6b492d40ff0 req-71c6e66f-6841-4c2f-98fe-6d8e61f4c6bd service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Neutron deleted interface 1f69add6-12dc-45a8-adbf-80da2c6332b5; detaching it from the instance and deleting it from the info cache
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.network.neutron [req-f8f5377e-ff24-4c41-b747-d6b492d40ff0 req-71c6e66f-6841-4c2f-98fe-6d8e61f4c6bd service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [{"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fde4098-19fb-4c28-98ad-1261432f29a7", "address": "fa:16:3e:ba:9e:a1", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fde4098-19", "ovs_interfaceid": "7fde4098-19fb-4c28-98ad-1261432f29a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d206dd-355e-4d82-b8a1-546afa38eee2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-f8f5377e-ff24-4c41-b747-d6b492d40ff0 req-71c6e66f-6841-4c2f-98fe-6d8e61f4c6bd service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Detach interface failed, port_id=1f69add6-12dc-45a8-adbf-80da2c6332b5, reason: Instance f7fc8ce3-8caa-49b7-9a76-601016e3cf31 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6086361d-1bcf-446f-ad06-78cf376a3269]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704c87f-69d5-445a-8e22-b5cc2f7b9752]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:46:43 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3c54f0-408b-40a0-bc0a-8a7a0e2b748f]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG os_brick.utils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Updating existing volume attachment record: d777fac7-c64e-433f-8d7f-f4cdd2e17381 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.network.neutron [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:46:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:46:43 user nova-compute[73007]: DEBUG nova.policy [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22977501a17f4458bb5c8be69a2c26b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40320dc41a5b47339fe34ded685fba41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:46:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Creating image(s)
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "/opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "/opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "/opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.238s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk 1073741824" returned: 0 in 0.050s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:44 user nova-compute[73007]: INFO nova.compute.manager [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Terminating instance
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.220s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.network.neutron [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Successfully created port: def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Cannot resize image /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.objects.instance [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'migration_context' on Instance uuid 66b9060e-47dd-4ac6-9277-501ff800bffa {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Ensure instance console log exists: /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-4553f39b-519b-4270-9712-da99cd625e55 req-cc9e9b3d-e63e-46e9-a0ea-481f02e24a5a service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received event network-vif-unplugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4553f39b-519b-4270-9712-da99cd625e55 req-cc9e9b3d-e63e-46e9-a0ea-481f02e24a5a service nova] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4553f39b-519b-4270-9712-da99cd625e55 req-cc9e9b3d-e63e-46e9-a0ea-481f02e24a5a service nova] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4553f39b-519b-4270-9712-da99cd625e55 req-cc9e9b3d-e63e-46e9-a0ea-481f02e24a5a service nova] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-4553f39b-519b-4270-9712-da99cd625e55 req-cc9e9b3d-e63e-46e9-a0ea-481f02e24a5a service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] No waiting events found dispatching network-vif-unplugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-4553f39b-519b-4270-9712-da99cd625e55 req-cc9e9b3d-e63e-46e9-a0ea-481f02e24a5a service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received event network-vif-unplugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:46:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Instance destroyed successfully.
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.objects.instance [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lazy-loading 'resources' on Instance uuid 06651cc4-57ab-440f-8fb8-5be64b7441f3 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1204663676',display_name='tempest-VolumesAssistedSnapshotsTest-server-1204663676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1204663676',id=7,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzsG4jYXnvxuf6GCzRXgKiezsRYRKUQTsjbByKTRwbRda0MnzxstXWjYGKhKDy6kNDi5FrEw90g8smQWkeFrHgyjabrPrL30GZE54cKuKlRQnxdjh6Sz0kFw6Z+eIJARQ==',key_name='tempest-keypair-2091667164',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fbf863175ad4e7090b13d1092f9a815',ramdisk_id='',reservation_id='r-ldvycod5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2009325632',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2009325632-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac1bbe9b65f04fbb834750e17f8ec56d',uuid=06651cc4-57ab-440f-8fb8-5be64b7441f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Converting VIF {"id": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "address": "fa:16:3e:1b:a6:a2", "network": {"id": "9cf4826a-d61a-4e74-b561-38b32967e497", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1753062160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fbf863175ad4e7090b13d1092f9a815", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c1f8c7c-1c", "ovs_interfaceid": "5c1f8c7c-1c21-453a-a08a-632a7e16d01a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a6:a2,bridge_name='br-int',has_traffic_filtering=True,id=5c1f8c7c-1c21-453a-a08a-632a7e16d01a,network=Network(9cf4826a-d61a-4e74-b561-38b32967e497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1f8c7c-1c') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG os_vif [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a6:a2,bridge_name='br-int',has_traffic_filtering=True,id=5c1f8c7c-1c21-453a-a08a-632a7e16d01a,network=Network(9cf4826a-d61a-4e74-b561-38b32967e497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1f8c7c-1c') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c1f8c7c-1c, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:45 user nova-compute[73007]: INFO os_vif [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a6:a2,bridge_name='br-int',has_traffic_filtering=True,id=5c1f8c7c-1c21-453a-a08a-632a7e16d01a,network=Network(9cf4826a-d61a-4e74-b561-38b32967e497),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c1f8c7c-1c')
Aug 15 17:46:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Deleting instance files /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3_del
Aug 15 17:46:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Deletion of /opt/stack/data/nova/instances/06651cc4-57ab-440f-8fb8-5be64b7441f3_del complete
Aug 15 17:46:45 user nova-compute[73007]: INFO nova.compute.manager [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 17:46:45 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-d779ffe3-26b4-40d0-b029-d17c58893184 req-7ca419fa-2120-4eff-9e7c-937b2ebe8310 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-deleted-7fde4098-19fb-4c28-98ad-1261432f29a7 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:45 user nova-compute[73007]: INFO nova.compute.manager [req-d779ffe3-26b4-40d0-b029-d17c58893184 req-7ca419fa-2120-4eff-9e7c-937b2ebe8310 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Neutron deleted interface 7fde4098-19fb-4c28-98ad-1261432f29a7; detaching it from the instance and deleting it from the info cache
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.network.neutron [req-d779ffe3-26b4-40d0-b029-d17c58893184 req-7ca419fa-2120-4eff-9e7c-937b2ebe8310 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [{"id": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "address": "fa:16:3e:16:d7:f9", "network": {"id": "0de346cf-f36f-4dcc-ace9-2ffedb421f18", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1510832494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b71bb57-eb", "ovs_interfaceid": "5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-d779ffe3-26b4-40d0-b029-d17c58893184 req-7ca419fa-2120-4eff-9e7c-937b2ebe8310 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Detach interface failed, port_id=7fde4098-19fb-4c28-98ad-1261432f29a7, reason: Instance f7fc8ce3-8caa-49b7-9a76-601016e3cf31 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-d779ffe3-26b4-40d0-b029-d17c58893184 req-7ca419fa-2120-4eff-9e7c-937b2ebe8310 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-deleted-5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:45 user nova-compute[73007]: INFO nova.compute.manager [req-d779ffe3-26b4-40d0-b029-d17c58893184 req-7ca419fa-2120-4eff-9e7c-937b2ebe8310 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Neutron deleted interface 5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6; detaching it from the instance and deleting it from the info cache
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.network.neutron [req-d779ffe3-26b4-40d0-b029-d17c58893184 req-7ca419fa-2120-4eff-9e7c-937b2ebe8310 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [{"id": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "address": "fa:16:3e:2d:3d:c9", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb52b824d-c6", "ovs_interfaceid": "b52b824d-c6b2-4297-ad8c-76c3b1eee05b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "04ba3529-e558-43a9-b673-ca64d4313656", "address": "fa:16:3e:7b:b4:15", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ba3529-e5", "ovs_interfaceid": "04ba3529-e558-43a9-b673-ca64d4313656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "address": "fa:16:3e:c6:85:42", "network": {"id": "2e5fa92c-7623-4d9b-b76e-f16a6a95cbb3", "bridge": "br-int", "label": "tempest-device-tagging-net1-645459308", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f777ec-67", "ovs_interfaceid": "c5f777ec-67fa-4a19-87bf-1cc734b9376e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6da276e6-e821-4371-b057-10a96c54117c", "address": "fa:16:3e:9d:9f:c2", "network": {"id": "2ed3ad51-9902-4c7e-9bcc-d32693432776", "bridge": "br-int", "label": "tempest-device-tagging-net2-918269387", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c9eb31865ff4bde98721c68030bc231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6da276e6-e8", "ovs_interfaceid": "6da276e6-e821-4371-b057-10a96c54117c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-d779ffe3-26b4-40d0-b029-d17c58893184 req-7ca419fa-2120-4eff-9e7c-937b2ebe8310 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Detach interface failed, port_id=5b71bb57-eb9b-4b9f-97c7-b737ee77a6d6, reason: Instance f7fc8ce3-8caa-49b7-9a76-601016e3cf31 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:46:46 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:46 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Took 5.86 seconds to deallocate network for instance.
Aug 15 17:46:46 user nova-compute[73007]: DEBUG nova.network.neutron [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Successfully updated port: def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:46:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "refresh_cache-66b9060e-47dd-4ac6-9277-501ff800bffa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:46:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquired lock "refresh_cache-66b9060e-47dd-4ac6-9277-501ff800bffa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:46:46 user nova-compute[73007]: DEBUG nova.network.neutron [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:46:46 user nova-compute[73007]: DEBUG nova.network.neutron [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Updating instance_info_cache with network_info: [{"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:47 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Took 1.54 seconds to deallocate network for instance.
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Releasing lock "refresh_cache-66b9060e-47dd-4ac6-9277-501ff800bffa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Instance network_info: |[{"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Start _get_guest_xml network_info=[{"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:46:47 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:46:47 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1304891267',display_name='tempest-VolumesAdminNegativeTest-server-1304891267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1304891267',id=14,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40320dc41a5b47339fe34ded685fba41',ramdisk_id='',reservation_id='r-csm4zx3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2030731104',owner_user_name='tempest-VolumesAdminNegativeTest-2030731104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:46:44Z,user_data=None,user_id='22977501a17f4458bb5c8be69a2c26b4',uuid=66b9060e-47dd-4ac6-9277-501ff800bffa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converting VIF {"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=def8484a-57bb-4e6b-9ed8-04c587a958ce,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef8484a-57') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.objects.instance [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'pci_devices' on Instance uuid 66b9060e-47dd-4ac6-9277-501ff800bffa {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:46:47 user nova-compute[73007]:   <uuid>66b9060e-47dd-4ac6-9277-501ff800bffa</uuid>
Aug 15 17:46:47 user nova-compute[73007]:   <name>instance-0000000e</name>
Aug 15 17:46:47 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:46:47 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:46:47 user nova-compute[73007]:   <metadata>
Aug 15 17:46:47 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:46:47 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:46:47 user nova-compute[73007]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1304891267</nova:name>
Aug 15 17:46:47 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:46:47</nova:creationTime>
Aug 15 17:46:47 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:46:47 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:46:47 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:46:47 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:46:47 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:46:47 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:46:47 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:46:47 user nova-compute[73007]:       <nova:owner>
Aug 15 17:46:47 user nova-compute[73007]:         <nova:user uuid="22977501a17f4458bb5c8be69a2c26b4">tempest-VolumesAdminNegativeTest-2030731104-project-member</nova:user>
Aug 15 17:46:47 user nova-compute[73007]:         <nova:project uuid="40320dc41a5b47339fe34ded685fba41">tempest-VolumesAdminNegativeTest-2030731104</nova:project>
Aug 15 17:46:47 user nova-compute[73007]:       </nova:owner>
Aug 15 17:46:47 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:46:47 user nova-compute[73007]:       <nova:ports>
Aug 15 17:46:47 user nova-compute[73007]:         <nova:port uuid="def8484a-57bb-4e6b-9ed8-04c587a958ce">
Aug 15 17:46:47 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 17:46:47 user nova-compute[73007]:         </nova:port>
Aug 15 17:46:47 user nova-compute[73007]:       </nova:ports>
Aug 15 17:46:47 user nova-compute[73007]:     </nova:instance>
Aug 15 17:46:47 user nova-compute[73007]:   </metadata>
Aug 15 17:46:47 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:46:47 user nova-compute[73007]:     <system>
Aug 15 17:46:47 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:46:47 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:46:47 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:46:47 user nova-compute[73007]:       <entry name="serial">66b9060e-47dd-4ac6-9277-501ff800bffa</entry>
Aug 15 17:46:47 user nova-compute[73007]:       <entry name="uuid">66b9060e-47dd-4ac6-9277-501ff800bffa</entry>
Aug 15 17:46:47 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:46:47 user nova-compute[73007]:     </system>
Aug 15 17:46:47 user nova-compute[73007]:   </sysinfo>
Aug 15 17:46:47 user nova-compute[73007]:   <os>
Aug 15 17:46:47 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:46:47 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:46:47 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:46:47 user nova-compute[73007]:   </os>
Aug 15 17:46:47 user nova-compute[73007]:   <features>
Aug 15 17:46:47 user nova-compute[73007]:     <acpi/>
Aug 15 17:46:47 user nova-compute[73007]:     <apic/>
Aug 15 17:46:47 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:46:47 user nova-compute[73007]:   </features>
Aug 15 17:46:47 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:46:47 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:46:47 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:46:47 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:46:47 user nova-compute[73007]:   </clock>
Aug 15 17:46:47 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:46:47 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:46:47 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:46:47 user nova-compute[73007]:   </cpu>
Aug 15 17:46:47 user nova-compute[73007]:   <devices>
Aug 15 17:46:47 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:46:47 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:46:47 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk"/>
Aug 15 17:46:47 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:46:47 user nova-compute[73007]:     </disk>
Aug 15 17:46:47 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:46:47 user nova-compute[73007]:       <mac address="fa:16:3e:01:ea:48"/>
Aug 15 17:46:47 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:46:47 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:46:47 user nova-compute[73007]:       <target dev="tapdef8484a-57"/>
Aug 15 17:46:47 user nova-compute[73007]:     </interface>
Aug 15 17:46:47 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:46:47 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/console.log" append="off"/>
Aug 15 17:46:47 user nova-compute[73007]:     </serial>
Aug 15 17:46:47 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:46:47 user nova-compute[73007]:     <video>
Aug 15 17:46:47 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:46:47 user nova-compute[73007]:     </video>
Aug 15 17:46:47 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:46:47 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:46:47 user nova-compute[73007]:     </rng>
Aug 15 17:46:47 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:46:47 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:46:47 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:46:47 user nova-compute[73007]:     </memballoon>
Aug 15 17:46:47 user nova-compute[73007]:   </devices>
Aug 15 17:46:47 user nova-compute[73007]: </domain>
Aug 15 17:46:47 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1304891267',display_name='tempest-VolumesAdminNegativeTest-server-1304891267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1304891267',id=14,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40320dc41a5b47339fe34ded685fba41',ramdisk_id='',reservation_id='r-csm4zx3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2030731104',owner_user_name='tempest-VolumesAdminNegativeTest-2030731104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:46:44Z,user_data=None,user_id='22977501a17f4458bb5c8be69a2c26b4',uuid=66b9060e-47dd-4ac6-9277-501ff800bffa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converting VIF {"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=def8484a-57bb-4e6b-9ed8-04c587a958ce,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef8484a-57') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG os_vif [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=def8484a-57bb-4e6b-9ed8-04c587a958ce,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef8484a-57') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdef8484a-57, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdef8484a-57, col_values=(('external_ids', {'iface-id': 'def8484a-57bb-4e6b-9ed8-04c587a958ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:ea:48', 'vm-uuid': '66b9060e-47dd-4ac6-9277-501ff800bffa'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:47 user nova-compute[73007]: INFO os_vif [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=def8484a-57bb-4e6b-9ed8-04c587a958ce,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef8484a-57')
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received event network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] Acquiring lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] No waiting events found dispatching network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:47 user nova-compute[73007]: WARNING nova.compute.manager [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received unexpected event network-vif-plugged-5c1f8c7c-1c21-453a-a08a-632a7e16d01a for instance with vm_state deleted and task_state None.
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received event network-changed-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Refreshing instance network info cache due to event network-changed-def8484a-57bb-4e6b-9ed8-04c587a958ce. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] Acquiring lock "refresh_cache-66b9060e-47dd-4ac6-9277-501ff800bffa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] Acquired lock "refresh_cache-66b9060e-47dd-4ac6-9277-501ff800bffa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.network.neutron [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Refreshing network info cache for port def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] No VIF found with MAC fa:16:3e:01:ea:48, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-b8e0a029-fadf-4e7c-b963-fd0b597e934c req-40790617-435e-4973-a45a-0dd4352e1530 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-deleted-c5f777ec-67fa-4a19-87bf-1cc734b9376e {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-b8e0a029-fadf-4e7c-b963-fd0b597e934c req-40790617-435e-4973-a45a-0dd4352e1530 service nova] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Received event network-vif-deleted-6da276e6-e821-4371-b057-10a96c54117c {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:47 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Deleted allocations for instance 06651cc4-57ab-440f-8fb8-5be64b7441f3
Aug 15 17:46:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-70f63946-841d-4efc-8aff-f2e94e47719b tempest-VolumesAssistedSnapshotsTest-2009325632 tempest-VolumesAssistedSnapshotsTest-2009325632-project-member] Lock "06651cc4-57ab-440f-8fb8-5be64b7441f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.295s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Updated VIF entry in instance network info cache for port def8484a-57bb-4e6b-9ed8-04c587a958ce. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Updating instance_info_cache with network_info: [{"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] Releasing lock "refresh_cache-66b9060e-47dd-4ac6-9277-501ff800bffa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-454403a3-c6a2-4c4f-a6c6-cc3fccf9e3b1 req-edd7b00f-92c8-46b1-b764-fc78615bd19b service nova] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Received event network-vif-deleted-5c1f8c7c-1c21-453a-a08a-632a7e16d01a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:48 user nova-compute[73007]: INFO nova.compute.manager [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Took 2.50 seconds to detach 3 volumes for instance.
Aug 15 17:46:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:49 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Deleted allocations for instance f7fc8ce3-8caa-49b7-9a76-601016e3cf31
Aug 15 17:46:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-036080a3-2891-43b7-bee0-2061fd763fb0 req-9fd47ca1-49db-4d09-ae13-81b16569090c service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received event network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-036080a3-2891-43b7-bee0-2061fd763fb0 req-9fd47ca1-49db-4d09-ae13-81b16569090c service nova] Acquiring lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-036080a3-2891-43b7-bee0-2061fd763fb0 req-9fd47ca1-49db-4d09-ae13-81b16569090c service nova] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-036080a3-2891-43b7-bee0-2061fd763fb0 req-9fd47ca1-49db-4d09-ae13-81b16569090c service nova] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-036080a3-2891-43b7-bee0-2061fd763fb0 req-9fd47ca1-49db-4d09-ae13-81b16569090c service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] No waiting events found dispatching network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:49 user nova-compute[73007]: WARNING nova.compute.manager [req-036080a3-2891-43b7-bee0-2061fd763fb0 req-9fd47ca1-49db-4d09-ae13-81b16569090c service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received unexpected event network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce for instance with vm_state building and task_state spawning.
Aug 15 17:46:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6e2caf77-767c-4c63-81f2-32428cb4684a tempest-TaggedBootDevicesTest_v242-89734460 tempest-TaggedBootDevicesTest_v242-89734460-project-member] Lock "f7fc8ce3-8caa-49b7-9a76-601016e3cf31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.755s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121611.2922788, 66b9060e-47dd-4ac6-9277-501ff800bffa => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:46:51 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] VM Resumed (Lifecycle Event)
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:46:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Instance spawned successfully.
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:46:51 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121611.2944894, 66b9060e-47dd-4ac6-9277-501ff800bffa => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:46:51 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] VM Started (Lifecycle Event)
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:46:51 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:46:51 user nova-compute[73007]: INFO nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Took 7.41 seconds to spawn the instance on the hypervisor.
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:46:51 user nova-compute[73007]: INFO nova.compute.manager [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Took 8.51 seconds to build instance.
Aug 15 17:46:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-692cf256-ac52-402c-b65d-371017f28d0a tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.617s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-e53565f4-a205-453e-8b17-c5fa47284c4a req-eada55ca-f934-4f2f-b33d-35d4b992f699 service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received event network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e53565f4-a205-453e-8b17-c5fa47284c4a req-eada55ca-f934-4f2f-b33d-35d4b992f699 service nova] Acquiring lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e53565f4-a205-453e-8b17-c5fa47284c4a req-eada55ca-f934-4f2f-b33d-35d4b992f699 service nova] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e53565f4-a205-453e-8b17-c5fa47284c4a req-eada55ca-f934-4f2f-b33d-35d4b992f699 service nova] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-e53565f4-a205-453e-8b17-c5fa47284c4a req-eada55ca-f934-4f2f-b33d-35d4b992f699 service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] No waiting events found dispatching network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:46:51 user nova-compute[73007]: WARNING nova.compute.manager [req-e53565f4-a205-453e-8b17-c5fa47284c4a req-eada55ca-f934-4f2f-b33d-35d4b992f699 service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received unexpected event network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce for instance with vm_state active and task_state None.
Aug 15 17:46:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121599.0015876, f7fc8ce3-8caa-49b7-9a76-601016e3cf31 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:46:54 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] VM Stopped (Lifecycle Event)
Aug 15 17:46:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d885de0e-c9eb-4e80-8dfe-a894bf631de4 None None] [instance: f7fc8ce3-8caa-49b7-9a76-601016e3cf31] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBsGzIkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:46:54 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:54 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:46:54 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab54a49-a0fb-4947-b007-03945cc77e11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:46:54 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae5f8d-d380-4074-949d-4719cba66a43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71] added
Aug 15 17:46:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bf82ed-6bbe-4591-b117-c6c4278ac3ed]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0473070d-e081-4012-9b25-d42e9b537c00]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SBsGzIkE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SBsGzIkE" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c10f06-fd69-47c5-bc27-39bcec585eda]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SBsGzIkE'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[07579518-720a-4290-87e1-c12b466d526c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a679f7cd-7f0d-4799-8c7d-989e3d880a54]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:54 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:54 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:54 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:54 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:54 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:54 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:54 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:54 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0149a90a-0f28-47d8-b478-ad33068fe576]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71, portal: 172.16.0.220,3260]
Aug 15 17:46:55 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71, portal: 172.16.0.220,3260] successful.
Aug 15 17:46:55 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff05db4-456b-4dfc-8629-8ef958e82432]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc9d2cb-efa0-4c44-9203-f37bfed4ef11]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:55 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:46:55 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:46:55 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7dedac-b705-4463-bcc6-f6b7907a6e80]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBsGzIkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:46:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23331346638323833', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331346638323833', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG nova.objects.instance [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'flavor' on Instance uuid 92002335-4c3a-4d9b-ba90-f1840c9142b5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:46:56 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:46:56 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:46:56 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:46:56 user nova-compute[73007]:   <serial>1f098273-a558-488d-b3b7-6b8837f2aa71</serial>
Aug 15 17:46:56 user nova-compute[73007]: </disk>
Aug 15 17:46:56 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No VIF found with MAC fa:16:3e:16:1f:7c, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:46:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-919e60c9-fb37-4c87-ba76-356acdd69e0e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.468s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:46:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:46:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:00 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121605.612344, 06651cc4-57ab-440f-8fb8-5be64b7441f3 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:00 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] VM Stopped (Lifecycle Event)
Aug 15 17:47:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c7498792-2e0d-4d1e-bb2e-41a1f069249c None None] [instance: 06651cc4-57ab-440f-8fb8-5be64b7441f3] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'flavor' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:03 user nova-compute[73007]: INFO nova.compute.manager [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Attaching volume 44ce30f1-39e1-448b-a041-b0f7bd1779ea to /dev/vdb
Aug 15 17:47:03 user nova-compute[73007]: DEBUG os_brick.utils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce524949-4eba-4248-834d-9f62b53a67a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[76233da1-2371-4fdb-9c49-610b2d2fee19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ecd1dc-1bc3-4ccd-9d65-f584763f745e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3e2098-23eb-45a7-b67f-56bacd21468e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:47:03 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:47:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[257437c3-ff8b-40a7-9fc1-a23213ad05d9]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG os_brick.utils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:03 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating existing volume attachment record: 236b17c9-afe8-4d76-9054-66c9874b8970 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:06 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:47:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:47:08 user nova-compute[73007]: INFO nova.compute.claims [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Claim successful on node user
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:47:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.policy [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f75799308247a5a796ef4c8530b6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189c104825c64a5a86cb9f3e3c4d55a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:47:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Creating image(s)
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.276s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.352s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk 1073741824" returned: 0 in 0.053s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.420s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.215s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:47:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Cannot resize image /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'migration_context' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Ensure instance console log exists: /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Successfully created port: 39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:47:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7482MB free_disk=25.58599853515625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:11 user nova-compute[73007]: INFO nova.compute.manager [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Unshelving
Aug 15 17:47:11 user nova-compute[73007]: INFO nova.virt.block_device [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Booting with volume d97f2255-077f-4b8e-88a5-d5ded468448b at /dev/vdc
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6b14b5d1-a493-4506-be76-029324a5aadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 31637822-05e9-4762-b3b3-2bc6e49efb6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 76bc99a0-7be4-480c-a7b1-11a9a557c645 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 92002335-4c3a-4d9b-ba90-f1840c9142b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e90005bb-24fc-4f17-9189-50b8ebd906ad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 0320a429-4c17-4337-a3c4-e6e806cf5305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 66b9060e-47dd-4ac6-9277-501ff800bffa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 2f4c50b0-1153-4b59-89d6-2192e5653827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance a82e6742-fe31-4693-8db5-50dc97f6072c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG os_brick.utils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb31d8ad-8b6d-4608-9ac3-035ed2483193]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc19739-5b0e-473c-8448-6e5616affa93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Successfully updated port: 39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4886d4ef-5d33-4b72-b43b-37c040b9f933]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[87627ef1-762a-4d05-8181-67c7987dd779]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-26944162-b1f3-4a3d-92f4-788be66ce2c0 req-87527ee9-8410-4baf-a713-508a2aa8da71 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-changed-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-26944162-b1f3-4a3d-92f4-788be66ce2c0 req-87527ee9-8410-4baf-a713-508a2aa8da71 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Refreshing instance network info cache due to event network-changed-39025734-6212-4fa0-8dff-4a91a091bdfb. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-26944162-b1f3-4a3d-92f4-788be66ce2c0 req-87527ee9-8410-4baf-a713-508a2aa8da71 service nova] Acquiring lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-26944162-b1f3-4a3d-92f4-788be66ce2c0 req-87527ee9-8410-4baf-a713-508a2aa8da71 service nova] Acquired lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-26944162-b1f3-4a3d-92f4-788be66ce2c0 req-87527ee9-8410-4baf-a713-508a2aa8da71 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Refreshing network info cache for port 39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:47:11 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:47:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62338ad-e39e-4a73-92d1-4bcd301a134a]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG os_brick.utils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating existing volume attachment record: 8abab581-2c8c-43c1-ac53-0a1978641a74 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:47:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-26944162-b1f3-4a3d-92f4-788be66ce2c0 req-87527ee9-8410-4baf-a713-508a2aa8da71 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-26944162-b1f3-4a3d-92f4-788be66ce2c0 req-87527ee9-8410-4baf-a713-508a2aa8da71 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-26944162-b1f3-4a3d-92f4-788be66ce2c0 req-87527ee9-8410-4baf-a713-508a2aa8da71 service nova] Releasing lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquired lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating instance_info_cache with network_info: [{"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Releasing lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Instance network_info: |[{"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Start _get_guest_xml network_info=[{"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:47:12 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:12 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converting VIF {"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:97:38,bridge_name='br-int',has_traffic_filtering=True,id=39025734-6212-4fa0-8dff-4a91a091bdfb,network=Network(18dc52e1-1158-441d-8f8a-07f36eaa206c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39025734-62') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:47:12 user nova-compute[73007]:   <uuid>2f4c50b0-1153-4b59-89d6-2192e5653827</uuid>
Aug 15 17:47:12 user nova-compute[73007]:   <name>instance-0000000f</name>
Aug 15 17:47:12 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:47:12 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:47:12 user nova-compute[73007]:   <metadata>
Aug 15 17:47:12 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:47:12 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:47:12 user nova-compute[73007]:       <nova:name>tempest-device-tagging-server-1208169056</nova:name>
Aug 15 17:47:12 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:47:12</nova:creationTime>
Aug 15 17:47:12 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:47:12 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:47:12 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:47:12 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:47:12 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:47:12 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:47:12 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:47:12 user nova-compute[73007]:       <nova:owner>
Aug 15 17:47:12 user nova-compute[73007]:         <nova:user uuid="85f75799308247a5a796ef4c8530b6d8">tempest-TaggedAttachmentsTest-1156291487-project-member</nova:user>
Aug 15 17:47:12 user nova-compute[73007]:         <nova:project uuid="189c104825c64a5a86cb9f3e3c4d55a4">tempest-TaggedAttachmentsTest-1156291487</nova:project>
Aug 15 17:47:12 user nova-compute[73007]:       </nova:owner>
Aug 15 17:47:12 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:47:12 user nova-compute[73007]:       <nova:ports>
Aug 15 17:47:12 user nova-compute[73007]:         <nova:port uuid="39025734-6212-4fa0-8dff-4a91a091bdfb">
Aug 15 17:47:12 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:47:12 user nova-compute[73007]:         </nova:port>
Aug 15 17:47:12 user nova-compute[73007]:       </nova:ports>
Aug 15 17:47:12 user nova-compute[73007]:     </nova:instance>
Aug 15 17:47:12 user nova-compute[73007]:   </metadata>
Aug 15 17:47:12 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:47:12 user nova-compute[73007]:     <system>
Aug 15 17:47:12 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:47:12 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:47:12 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:47:12 user nova-compute[73007]:       <entry name="serial">2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:47:12 user nova-compute[73007]:       <entry name="uuid">2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:47:12 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:47:12 user nova-compute[73007]:     </system>
Aug 15 17:47:12 user nova-compute[73007]:   </sysinfo>
Aug 15 17:47:12 user nova-compute[73007]:   <os>
Aug 15 17:47:12 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:47:12 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:47:12 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:47:12 user nova-compute[73007]:   </os>
Aug 15 17:47:12 user nova-compute[73007]:   <features>
Aug 15 17:47:12 user nova-compute[73007]:     <acpi/>
Aug 15 17:47:12 user nova-compute[73007]:     <apic/>
Aug 15 17:47:12 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:47:12 user nova-compute[73007]:   </features>
Aug 15 17:47:12 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:47:12 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:47:12 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:47:12 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:47:12 user nova-compute[73007]:   </clock>
Aug 15 17:47:12 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:47:12 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:47:12 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:47:12 user nova-compute[73007]:   </cpu>
Aug 15 17:47:12 user nova-compute[73007]:   <devices>
Aug 15 17:47:12 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:47:12 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:47:12 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk"/>
Aug 15 17:47:12 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:47:12 user nova-compute[73007]:     </disk>
Aug 15 17:47:12 user nova-compute[73007]:     <disk type="file" device="cdrom">
Aug 15 17:47:12 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 17:47:12 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.config"/>
Aug 15 17:47:12 user nova-compute[73007]:       <target dev="hda" bus="ide"/>
Aug 15 17:47:12 user nova-compute[73007]:     </disk>
Aug 15 17:47:12 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:47:12 user nova-compute[73007]:       <mac address="fa:16:3e:cd:97:38"/>
Aug 15 17:47:12 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:47:12 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:47:12 user nova-compute[73007]:       <target dev="tap39025734-62"/>
Aug 15 17:47:12 user nova-compute[73007]:     </interface>
Aug 15 17:47:12 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:47:12 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log" append="off"/>
Aug 15 17:47:12 user nova-compute[73007]:     </serial>
Aug 15 17:47:12 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:47:12 user nova-compute[73007]:     <video>
Aug 15 17:47:12 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:47:12 user nova-compute[73007]:     </video>
Aug 15 17:47:12 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:47:12 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:47:12 user nova-compute[73007]:     </rng>
Aug 15 17:47:12 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:47:12 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:47:12 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:47:12 user nova-compute[73007]:     </memballoon>
Aug 15 17:47:12 user nova-compute[73007]:   </devices>
Aug 15 17:47:12 user nova-compute[73007]: </domain>
Aug 15 17:47:12 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:47:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converting VIF {"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:97:38,bridge_name='br-int',has_traffic_filtering=True,id=39025734-6212-4fa0-8dff-4a91a091bdfb,network=Network(18dc52e1-1158-441d-8f8a-07f36eaa206c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39025734-62') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG os_vif [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:97:38,bridge_name='br-int',has_traffic_filtering=True,id=39025734-6212-4fa0-8dff-4a91a091bdfb,network=Network(18dc52e1-1158-441d-8f8a-07f36eaa206c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39025734-62') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39025734-62, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39025734-62, col_values=(('external_ids', {'iface-id': '39025734-6212-4fa0-8dff-4a91a091bdfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:97:38', 'vm-uuid': '2f4c50b0-1153-4b59-89d6-2192e5653827'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:12 user nova-compute[73007]: INFO os_vif [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:97:38,bridge_name='br-int',has_traffic_filtering=True,id=39025734-6212-4fa0-8dff-4a91a091bdfb,network=Network(18dc52e1-1158-441d-8f8a-07f36eaa206c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39025734-62')
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No BDM found with device name hda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No VIF found with MAC fa:16:3e:cd:97:38, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:47:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Using config drive
Aug 15 17:47:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Creating config drive at /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.config
Aug 15 17:47:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4gfv3njh {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4gfv3njh" returned: 0 in 0.055s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-8b9b5f4f-92aa-4a95-9b5c-7abffcde2f3b req-959e580f-e2c9-47b1-8a6e-336e7e9ce514 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8b9b5f4f-92aa-4a95-9b5c-7abffcde2f3b req-959e580f-e2c9-47b1-8a6e-336e7e9ce514 service nova] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8b9b5f4f-92aa-4a95-9b5c-7abffcde2f3b req-959e580f-e2c9-47b1-8a6e-336e7e9ce514 service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8b9b5f4f-92aa-4a95-9b5c-7abffcde2f3b req-959e580f-e2c9-47b1-8a6e-336e7e9ce514 service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-8b9b5f4f-92aa-4a95-9b5c-7abffcde2f3b req-959e580f-e2c9-47b1-8a6e-336e7e9ce514 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] No waiting events found dispatching network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:14 user nova-compute[73007]: WARNING nova.compute.manager [req-8b9b5f4f-92aa-4a95-9b5c-7abffcde2f3b req-959e580f-e2c9-47b1-8a6e-336e7e9ce514 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received unexpected event network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb for instance with vm_state building and task_state spawning.
Aug 15 17:47:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYcNbAwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:15 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:15 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:15 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb2e0c-4a20-43a5-90b6-139e9a5e259c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:47:15 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[527fbd28-11d2-4a41-9e13-a929d48e46a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea] added
Aug 15 17:47:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[97318e16-74df-45fd-99fa-7c843b06eec0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eff54f5-347a-49b6-95ea-ab55f2683f62]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYcNbAwX {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYcNbAwX" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdb22f9-a674-4b36-9b2b-c50a0f91d689]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYcNbAwX'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb91dd-8cec-4c02-bf98-6f19d4aaf3bc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3369a53c-7444-4f34-84b8-300baa453422]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[99605868-527f-48b0-8c41-a02c76860eee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea, portal: 172.16.0.220,3260]
Aug 15 17:47:15 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea, portal: 172.16.0.220,3260] successful.
Aug 15 17:47:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a022ec-fe75-4f77-984a-10cc617a24df]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeade2a-8230-4049-9d8f-a259dbb6ef63]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[94974bdd-1bc0-4fe9-97da-43e97f757def]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:47:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYcNbAwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-ba3966e4-93db-4a7f-bb33-c1624cb789dc req-bdf9dd10-2c9e-40fd-96ae-6ca34ca33a7d service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ba3966e4-93db-4a7f-bb33-c1624cb789dc req-bdf9dd10-2c9e-40fd-96ae-6ca34ca33a7d service nova] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ba3966e4-93db-4a7f-bb33-c1624cb789dc req-bdf9dd10-2c9e-40fd-96ae-6ca34ca33a7d service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ba3966e4-93db-4a7f-bb33-c1624cb789dc req-bdf9dd10-2c9e-40fd-96ae-6ca34ca33a7d service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-ba3966e4-93db-4a7f-bb33-c1624cb789dc req-bdf9dd10-2c9e-40fd-96ae-6ca34ca33a7d service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] No waiting events found dispatching network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:16 user nova-compute[73007]: WARNING nova.compute.manager [req-ba3966e4-93db-4a7f-bb33-c1624cb789dc req-bdf9dd10-2c9e-40fd-96ae-6ca34ca33a7d service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received unexpected event network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb for instance with vm_state building and task_state spawning.
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121636.82931, 2f4c50b0-1153-4b59-89d6-2192e5653827 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] VM Resumed (Lifecycle Event)
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:47:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Instance spawned successfully.
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:47:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121636.838148, 2f4c50b0-1153-4b59-89d6-2192e5653827 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] VM Started (Lifecycle Event)
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:47:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:47:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23665333063376431', 'path': '/dev/sdc'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665333063376431', 'path': '/dev/sdc'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'flavor' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:16 user nova-compute[73007]: INFO nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Took 7.98 seconds to spawn the instance on the hypervisor.
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:47:16 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:47:16 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 17:47:16 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:47:16 user nova-compute[73007]:   <serial>44ce30f1-39e1-448b-a041-b0f7bd1779ea</serial>
Aug 15 17:47:16 user nova-compute[73007]: </disk>
Aug 15 17:47:16 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:47:17 user nova-compute[73007]: INFO nova.compute.manager [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Took 9.08 seconds to build instance.
Aug 15 17:47:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4335000-3939-4c05-992a-702974531684 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.183s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No VIF found with MAC fa:16:3e:13:52:73, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:47:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b1773e0f-f9f6-40f9-a8ee-2f182f4b8d82 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.985s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:18 user nova-compute[73007]: INFO nova.compute.manager [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Rescuing
Aug 15 17:47:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquired lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:47:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Releasing lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-93d2e330-cae3-4b96-a6b3-a3be07029278 req-673b7500-226e-4d53-abed-d08027d3fcea service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-93d2e330-cae3-4b96-a6b3-a3be07029278 req-673b7500-226e-4d53-abed-d08027d3fcea service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-93d2e330-cae3-4b96-a6b3-a3be07029278 req-673b7500-226e-4d53-abed-d08027d3fcea service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-93d2e330-cae3-4b96-a6b3-a3be07029278 req-673b7500-226e-4d53-abed-d08027d3fcea service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-93d2e330-cae3-4b96-a6b3-a3be07029278 req-673b7500-226e-4d53-abed-d08027d3fcea service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:19 user nova-compute[73007]: WARNING nova.compute.manager [req-93d2e330-cae3-4b96-a6b3-a3be07029278 req-673b7500-226e-4d53-abed-d08027d3fcea service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state active and task_state rescuing.
Aug 15 17:47:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance destroyed successfully.
Aug 15 17:47:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Attempting a stable device rescue
Aug 15 17:47:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73007) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance directory exists: not creating {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 17:47:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Creating image(s)
Aug 15 17:47:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "4184f4b710a1236d0f260b87d1fe448c06f910d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "4184f4b710a1236d0f260b87d1fe448c06f910d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4.part --force-share --output=json" returned: 0 in 0.208s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:20 user nova-compute[73007]: DEBUG nova.virt.images [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] 1b43d363-d1aa-4811-bc16-3ae9334f913c was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 17:47:20 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:47:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4.part /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4.part /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4.converted" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "4184f4b710a1236d0f260b87d1fe448c06f910d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.417s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "4184f4b710a1236d0f260b87d1fe448c06f910d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "4184f4b710a1236d0f260b87d1fe448c06f910d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-b122cb1a-bc29-4a3f-87b8-6c0f10add68d req-30929e73-d8ac-4ddb-a0d5-94dc3f276721 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b122cb1a-bc29-4a3f-87b8-6c0f10add68d req-30929e73-d8ac-4ddb-a0d5-94dc3f276721 service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b122cb1a-bc29-4a3f-87b8-6c0f10add68d req-30929e73-d8ac-4ddb-a0d5-94dc3f276721 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b122cb1a-bc29-4a3f-87b8-6c0f10add68d req-30929e73-d8ac-4ddb-a0d5-94dc3f276721 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-b122cb1a-bc29-4a3f-87b8-6c0f10add68d req-30929e73-d8ac-4ddb-a0d5-94dc3f276721 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:21 user nova-compute[73007]: WARNING nova.compute.manager [req-b122cb1a-bc29-4a3f-87b8-6c0f10add68d req-30929e73-d8ac-4ddb-a0d5-94dc3f276721 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state active and task_state rescuing.
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4 --force-share --output=json" returned: 0 in 0.272s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4,backing_fmt=raw /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4,backing_fmt=raw /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue" returned: 0 in 0.058s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "4184f4b710a1236d0f260b87d1fe448c06f910d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'migration_context' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Start _get_guest_xml network_info=[{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "vif_mac": "fa:16:3e:13:52:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1b43d363-d1aa-4811-bc16-3ae9334f913c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYcNbAwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6b14b5d1-a493-4506-be76-029324a5aadd', 'attached_at': '', 'detached_at': '', 'volume_id': '44ce30f1-39e1-448b-a041-b0f7bd1779ea', 'serial': '44ce30f1-39e1-448b-a041-b0f7bd1779ea'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '236b17c9-afe8-4d76-9054-66c9874b8970', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'resources' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:21 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:21 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYcNbAwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:21 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:21 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:21 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ee936f-ef2f-40b0-8499-16fb7f642c1f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UYcNbAwX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 17:47:21 user nova-compute[73007]: node.name = iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea
Aug 15 17:47:21 user nova-compute[73007]: node.tpgt = -1
Aug 15 17:47:21 user nova-compute[73007]: node.startup = automatic
Aug 15 17:47:21 user nova-compute[73007]: node.leading_login = No
Aug 15 17:47:21 user nova-compute[73007]: iface.iscsi_ifacename = default
Aug 15 17:47:21 user nova-compute[73007]: iface.net_ifacename = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.ipaddress = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.prefix_len = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.hwaddress = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.transport_name = tcp
Aug 15 17:47:21 user nova-compute[73007]: iface.initiatorname = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.state = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.vlan_id = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.vlan_priority = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.vlan_state = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.iface_num = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.mtu = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.port = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.bootproto = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.subnet_mask = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.gateway = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.dhcp_alt_client_id = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.dhcp_dns = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.dhcp_learn_iqn = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.dhcp_vendor_id_state = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.dhcp_vendor_id = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.dhcp_slp_da = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.fragmentation = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.gratuitous_arp = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.incoming_forwarding = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.tos_state = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.tos = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.ttl = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.delayed_ack = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.tcp_nagle = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.tcp_wsf_state = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.tcp_wsf = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.tcp_timer_scale = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.tcp_timestamp = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.redirect = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.def_task_mgmt_timeout = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.header_digest = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.data_digest = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.immediate_data = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.initial_r2t = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.data_seq_inorder = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.data_pdu_inorder = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.erl = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.max_receive_data_len = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.first_burst_len = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.max_outstanding_r2t = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.max_burst_len = 0
Aug 15 17:47:21 user nova-compute[73007]: iface.chap_auth = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.bidi_chap = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.strict_login_compliance = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.discovery_auth = <empty>
Aug 15 17:47:21 user nova-compute[73007]: iface.discovery_logout = <empty>
Aug 15 17:47:21 user nova-compute[73007]: node.discovery_address = <empty>
Aug 15 17:47:21 user nova-compute[73007]: node.discovery_port = 0
Aug 15 17:47:21 user nova-compute[73007]: node.discovery_type = static
Aug 15 17:47:21 user nova-compute[73007]: node.session.initial_cmdsn = 0
Aug 15 17:47:21 user nova-compute[73007]: node.session.initial_login_retry_max = 8
Aug 15 17:47:21 user nova-compute[73007]: node.session.xmit_thread_priority = -20
Aug 15 17:47:21 user nova-compute[73007]: node.session.cmds_max = 128
Aug 15 17:47:21 user nova-compute[73007]: node.session.queue_depth = 32
Aug 15 17:47:21 user nova-compute[73007]: node.session.nr_sessions = 1
Aug 15 17:47:21 user nova-compute[73007]: node.session.auth.authmethod = CHAP
Aug 15 17:47:21 user nova-compute[73007]: node.session.auth.username = UYcNbAwX
Aug 15 17:47:21 user nova-compute[73007]: node.session.auth.password = ***
Aug 15 17:47:21 user nova-compute[73007]: node.session.auth.username_in = <empty>
Aug 15 17:47:21 user nova-compute[73007]: node.session.auth.password_in = <empty>
Aug 15 17:47:21 user nova-compute[73007]: node.session.auth.chap_algs = MD5
Aug 15 17:47:21 user nova-compute[73007]: node.session.timeo.replacement_timeout = 120
Aug 15 17:47:21 user nova-compute[73007]: node.session.err_timeo.abort_timeout = 15
Aug 15 17:47:21 user nova-compute[73007]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 17:47:21 user nova-compute[73007]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 17:47:21 user nova-compute[73007]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.FastAbort = Yes
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.InitialR2T = No
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.ImmediateData = Yes
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.MaxConnections = 1
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 17:47:21 user nova-compute[73007]: node.session.iscsi.ERL = 0
Aug 15 17:47:21 user nova-compute[73007]: node.session.scan = manual
Aug 15 17:47:21 user nova-compute[73007]: node.session.reopen_max = 0
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].address = 172.16.0.220
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].port = 3260
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].startup = manual
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].tcp.window_size = 524288
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].tcp.type_of_service = 0
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].timeo.logout_timeout = 15
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].timeo.login_timeout = 15
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].timeo.auth_timeout = 45
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].iscsi.DataDigest = None
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].iscsi.IFMarker = No
Aug 15 17:47:21 user nova-compute[73007]: node.conn[0].iscsi.OFMarker = No
Aug 15 17:47:21 user nova-compute[73007]: # END RECORD
Aug 15 17:47:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3451ff0d-3325-46ba-b56d-24fdeeb57c5e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5ebdb0-6477-4ef9-85a4-e2bdd60a5fe3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYcNbAwX {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYcNbAwX" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6906cc-2e9b-4ee1-8d46-f2485cdd8bc7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYcNbAwX'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf2d217-b95d-49f2-b414-da517075d653]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff344b8-e296-4824-8a11-0616890b784f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:21 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] HCTL ('34', '0', '0', 0) found on session 18 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4b59ba-ad5a-4cec-bc98-0b1f1591b90c]: (4, ('0 0 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Searching for a device in session 18 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYcNbAwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.190s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23665333063376431', 'path': '/dev/sdc'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665333063376431', 'path': '/dev/sdc'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1601217636',display_name='tempest-ServerStableDeviceRescueTest-server-1601217636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1601217636',id=5,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6fDWuzEVq/DVBeB7mtTRrD/fi2/SBj5rmbBPPs4B6BhnLzf8/8g05D7jlSdp2dfBdUytS4ffKyfoSx1xaRX9ixwki3Ieg4b39NYClkJRpH7USbFwcrreCMLTbEMzR+GQ==',key_name='tempest-keypair-929768774',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097ecc4c5c86438b94fd930ca13f47dc',ramdisk_id='',reservation_id='r-yvriih0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-173917546',owner_user_name='tempest-ServerStableDeviceRescueTest-173917546-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f13824fa664d9ca209ec7b4d826bdf',uuid=6b14b5d1-a493-4506-be76-029324a5aadd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "vif_mac": "fa:16:3e:13:52:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Converting VIF {"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "vif_mac": "fa:16:3e:13:52:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:52:73,bridge_name='br-int',has_traffic_filtering=True,id=74017a60-7a29-446b-9f9d-d26f80ddbba6,network=Network(6a895edd-4249-4372-8fe4-f76cd74491cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74017a60-7a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:47:21 user nova-compute[73007]:   <uuid>6b14b5d1-a493-4506-be76-029324a5aadd</uuid>
Aug 15 17:47:21 user nova-compute[73007]:   <name>instance-00000005</name>
Aug 15 17:47:21 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:47:21 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:47:21 user nova-compute[73007]:   <metadata>
Aug 15 17:47:21 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:47:21 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:47:21 user nova-compute[73007]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1601217636</nova:name>
Aug 15 17:47:21 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:47:21</nova:creationTime>
Aug 15 17:47:21 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:47:21 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:47:21 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:47:21 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:47:21 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:47:21 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:47:21 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:47:21 user nova-compute[73007]:       <nova:owner>
Aug 15 17:47:21 user nova-compute[73007]:         <nova:user uuid="f6f13824fa664d9ca209ec7b4d826bdf">tempest-ServerStableDeviceRescueTest-173917546-project-member</nova:user>
Aug 15 17:47:21 user nova-compute[73007]:         <nova:project uuid="097ecc4c5c86438b94fd930ca13f47dc">tempest-ServerStableDeviceRescueTest-173917546</nova:project>
Aug 15 17:47:21 user nova-compute[73007]:       </nova:owner>
Aug 15 17:47:21 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:47:21 user nova-compute[73007]:       <nova:ports>
Aug 15 17:47:21 user nova-compute[73007]:         <nova:port uuid="74017a60-7a29-446b-9f9d-d26f80ddbba6">
Aug 15 17:47:21 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 17:47:21 user nova-compute[73007]:         </nova:port>
Aug 15 17:47:21 user nova-compute[73007]:       </nova:ports>
Aug 15 17:47:21 user nova-compute[73007]:     </nova:instance>
Aug 15 17:47:21 user nova-compute[73007]:   </metadata>
Aug 15 17:47:21 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:47:21 user nova-compute[73007]:     <system>
Aug 15 17:47:21 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:47:21 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:47:21 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:47:21 user nova-compute[73007]:       <entry name="serial">6b14b5d1-a493-4506-be76-029324a5aadd</entry>
Aug 15 17:47:21 user nova-compute[73007]:       <entry name="uuid">6b14b5d1-a493-4506-be76-029324a5aadd</entry>
Aug 15 17:47:21 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:47:21 user nova-compute[73007]:     </system>
Aug 15 17:47:21 user nova-compute[73007]:   </sysinfo>
Aug 15 17:47:21 user nova-compute[73007]:   <os>
Aug 15 17:47:21 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:47:21 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:47:21 user nova-compute[73007]:   </os>
Aug 15 17:47:21 user nova-compute[73007]:   <features>
Aug 15 17:47:21 user nova-compute[73007]:     <acpi/>
Aug 15 17:47:21 user nova-compute[73007]:     <apic/>
Aug 15 17:47:21 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:47:21 user nova-compute[73007]:   </features>
Aug 15 17:47:21 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:47:21 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:47:21 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:47:21 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:47:21 user nova-compute[73007]:   </clock>
Aug 15 17:47:21 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:47:21 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:47:21 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:47:21 user nova-compute[73007]:   </cpu>
Aug 15 17:47:21 user nova-compute[73007]:   <devices>
Aug 15 17:47:21 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:47:21 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:47:21 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk"/>
Aug 15 17:47:21 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:47:21 user nova-compute[73007]:     </disk>
Aug 15 17:47:21 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:47:21 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:47:21 user nova-compute[73007]:       <source dev="/dev/sdc"/>
Aug 15 17:47:21 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:47:21 user nova-compute[73007]:       <serial>44ce30f1-39e1-448b-a041-b0f7bd1779ea</serial>
Aug 15 17:47:21 user nova-compute[73007]:     </disk>
Aug 15 17:47:21 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:47:21 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:47:21 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue"/>
Aug 15 17:47:21 user nova-compute[73007]:       <target dev="vdc" bus="virtio"/>
Aug 15 17:47:21 user nova-compute[73007]:       <boot order="1"/>
Aug 15 17:47:21 user nova-compute[73007]:     </disk>
Aug 15 17:47:21 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:47:21 user nova-compute[73007]:       <mac address="fa:16:3e:13:52:73"/>
Aug 15 17:47:21 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:47:21 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:47:21 user nova-compute[73007]:       <target dev="tap74017a60-7a"/>
Aug 15 17:47:21 user nova-compute[73007]:     </interface>
Aug 15 17:47:21 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:47:21 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/console.log" append="off"/>
Aug 15 17:47:21 user nova-compute[73007]:     </serial>
Aug 15 17:47:21 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:47:21 user nova-compute[73007]:     <video>
Aug 15 17:47:21 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:47:21 user nova-compute[73007]:     </video>
Aug 15 17:47:21 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:47:21 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:47:21 user nova-compute[73007]:     </rng>
Aug 15 17:47:21 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:47:21 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:47:21 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:47:21 user nova-compute[73007]:     </memballoon>
Aug 15 17:47:21 user nova-compute[73007]:   </devices>
Aug 15 17:47:21 user nova-compute[73007]: </domain>
Aug 15 17:47:21 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:47:21 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance destroyed successfully.
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] No VIF found with MAC fa:16:3e:13:52:73, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:47:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG nova.objects.instance [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'pci_requests' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG nova.objects.instance [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'numa_topology' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:47:23 user nova-compute[73007]: INFO nova.compute.claims [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Claim successful on node user
Aug 15 17:47:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-e74f728e-5533-42cd-839e-8bb053e4e0b1 req-f2bb51d8-17bb-4e26-9918-ffea8851193d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e74f728e-5533-42cd-839e-8bb053e4e0b1 req-f2bb51d8-17bb-4e26-9918-ffea8851193d service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e74f728e-5533-42cd-839e-8bb053e4e0b1 req-f2bb51d8-17bb-4e26-9918-ffea8851193d service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e74f728e-5533-42cd-839e-8bb053e4e0b1 req-f2bb51d8-17bb-4e26-9918-ffea8851193d service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-e74f728e-5533-42cd-839e-8bb053e4e0b1 req-f2bb51d8-17bb-4e26-9918-ffea8851193d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:23 user nova-compute[73007]: WARNING nova.compute.manager [req-e74f728e-5533-42cd-839e-8bb053e4e0b1 req-f2bb51d8-17bb-4e26-9918-ffea8851193d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state active and task_state rescuing.
Aug 15 17:47:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:24 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:47:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:24 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:47:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:24 user nova-compute[73007]: INFO nova.network.neutron [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating port ddf68e4b-1015-4964-9b62-d41585fd04fc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquired lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-8a1e92d9-9fb6-4e24-8f98-65d619e1c0b6 req-a3ed6cc4-3923-4d6f-bfc6-6fa815456d7b service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-changed-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-8a1e92d9-9fb6-4e24-8f98-65d619e1c0b6 req-a3ed6cc4-3923-4d6f-bfc6-6fa815456d7b service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Refreshing instance network info cache due to event network-changed-ddf68e4b-1015-4964-9b62-d41585fd04fc. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8a1e92d9-9fb6-4e24-8f98-65d619e1c0b6 req-a3ed6cc4-3923-4d6f-bfc6-6fa815456d7b service nova] Acquiring lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquired lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'info_cache' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-9022aa37-57f7-4b45-8cdf-29559749a68d req-7fe6e063-1e88-4599-baf7-a8ed69532e0e service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9022aa37-57f7-4b45-8cdf-29559749a68d req-7fe6e063-1e88-4599-baf7-a8ed69532e0e service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9022aa37-57f7-4b45-8cdf-29559749a68d req-7fe6e063-1e88-4599-baf7-a8ed69532e0e service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9022aa37-57f7-4b45-8cdf-29559749a68d req-7fe6e063-1e88-4599-baf7-a8ed69532e0e service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-9022aa37-57f7-4b45-8cdf-29559749a68d req-7fe6e063-1e88-4599-baf7-a8ed69532e0e service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:25 user nova-compute[73007]: WARNING nova.compute.manager [req-9022aa37-57f7-4b45-8cdf-29559749a68d req-7fe6e063-1e88-4599-baf7-a8ed69532e0e service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state active and task_state rescuing.
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for 6b14b5d1-a493-4506-be76-029324a5aadd due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121645.8090715, 6b14b5d1-a493-4506-be76-029324a5aadd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:25 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] VM Resumed (Lifecycle Event)
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-bf78c360-505c-454c-b606-996127de689f tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Releasing lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:47:25 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Creating image(s)
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.objects.instance [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'trusted_certs' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8a1e92d9-9fb6-4e24-8f98-65d619e1c0b6 req-a3ed6cc4-3923-4d6f-bfc6-6fa815456d7b service nova] Acquired lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-8a1e92d9-9fb6-4e24-8f98-65d619e1c0b6 req-a3ed6cc4-3923-4d6f-bfc6-6fa815456d7b service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Refreshing network info cache for port ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "1d0d00577b56ee716c9dff38b1d0632d398ed617" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "1d0d00577b56ee716c9dff38b1d0632d398ed617" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:47:25 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 17:47:25 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121645.8102865, 6b14b5d1-a493-4506-be76-029324a5aadd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:25 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] VM Started (Lifecycle Event)
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Releasing lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance destroyed successfully.
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'resources' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_vif [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c926c8a-89, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:26 user nova-compute[73007]: INFO os_vif [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89')
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPnHkcZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:26 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617.part --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.virt.images [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] 2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617.part /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c55543-3e2b-4a19-aec2-9c79115dab0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2019c961-616f-4f48-a601-21671392e475]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:26 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:26 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:26 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7b1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c715e829-eb71-4112-b776-736b4d9eee37]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485ac09-f51c-439b-9323-9c63e3a87e89]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d22317-ea2c-4b76-92c4-ddb1995f5429]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1184fa-c3bc-412b-afae-28063a9e58f0]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.077s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[193cd9dc-5bf8-4fb7-baa4-5233a6253854]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.network.neutron [req-8a1e92d9-9fb6-4e24-8f98-65d619e1c0b6 req-a3ed6cc4-3923-4d6f-bfc6-6fa815456d7b service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updated VIF entry in instance network info cache for port ddf68e4b-1015-4964-9b62-d41585fd04fc. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.network.neutron [req-8a1e92d9-9fb6-4e24-8f98-65d619e1c0b6 req-a3ed6cc4-3923-4d6f-bfc6-6fa815456d7b service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617.part /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617.converted" returned: 0 in 0.372s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eac58ab-528f-43bf-86fe-21f23ab88316]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260]
Aug 15 17:47:27 user nova-compute[73007]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260] successful.
Aug 15 17:47:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-472cef44-b62c-4e3a-9ddb-3070499047c6 req-d73347cb-f3a3-4c17-b9b1-ac586e4545cc service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received event network-changed-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-472cef44-b62c-4e3a-9ddb-3070499047c6 req-d73347cb-f3a3-4c17-b9b1-ac586e4545cc service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Refreshing instance network info cache due to event network-changed-1f8e9d05-5a62-464d-b697-2a8210d318b4. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-472cef44-b62c-4e3a-9ddb-3070499047c6 req-d73347cb-f3a3-4c17-b9b1-ac586e4545cc service nova] Acquiring lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-472cef44-b62c-4e3a-9ddb-3070499047c6 req-d73347cb-f3a3-4c17-b9b1-ac586e4545cc service nova] Acquired lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.network.neutron [req-472cef44-b62c-4e3a-9ddb-3070499047c6 req-d73347cb-f3a3-4c17-b9b1-ac586e4545cc service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Refreshing network info cache for port 1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8a1e92d9-9fb6-4e24-8f98-65d619e1c0b6 req-a3ed6cc4-3923-4d6f-bfc6-6fa815456d7b service nova] Releasing lock "refresh_cache-a82e6742-fe31-4693-8db5-50dc97f6072c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30f99b7-e833-4471-b95e-630d96699851]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.503s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== disconnect_volume: return (504ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Start _get_guest_xml network_info=[{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPnHkcZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '42c38120-5e1d-4438-a53b-8a188e417c91', 'attached_at': '', 'detached_at': '', 'volume_id': '71574eb8-e7fd-402a-8b17-9d8fee4997ff', 'serial': '71574eb8-e7fd-402a-8b17-9d8fee4997ff'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'e9e02e7c-60e0-4e66-aa8d-778ffdb6714b', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'numa_topology' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:27 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:27 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPnHkcZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:27 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:27 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:27 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "1d0d00577b56ee716c9dff38b1d0632d398ed617" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.615s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[67218d3a-15a9-4380-a627-bf0ae8151e66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:47:27 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8740fb5-4b8c-4ba7-bd5c-0b01c4beb0bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff] added
Aug 15 17:47:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0639c2cf-6fe4-4dc2-b2ba-9b0866e072f2]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bb10a7-d0e3-4d60-9534-d9b2e82185f6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPnHkcZT {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LPnHkcZT" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8686dc56-7a57-450a-9ba3-85730327b1d7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LPnHkcZT'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee4c7fa-fafd-48ff-a79d-83920a32fbbc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617 --force-share --output=json" returned: 0 in 0.225s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "1d0d00577b56ee716c9dff38b1d0632d398ed617" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "1d0d00577b56ee716c9dff38b1d0632d398ed617" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5646df1a-a2cd-406f-a256-81640bcec853]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:27 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "0320a429-4c17-4337-a3c4-e6e806cf5305" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:27 user nova-compute[73007]: INFO nova.compute.manager [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Terminating instance
Aug 15 17:47:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[54132775-7c74-4402-ab68-595e0b431216]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617 --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260]
Aug 15 17:47:27 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260] successful.
Aug 15 17:47:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617,backing_fmt=raw /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ea2e99-34bd-4d31-ada9-1c565edadb12]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617,backing_fmt=raw /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk 1073741824" returned: 0 in 0.091s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "1d0d00577b56ee716c9dff38b1d0632d398ed617" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb6344a-e146-45cb-9029-9f053653c6d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:28 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:28 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:28 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.588s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2622a4a-d285-4823-b812-8da600988710]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-472cef44-b62c-4e3a-9ddb-3070499047c6 req-d73347cb-f3a3-4c17-b9b1-ac586e4545cc service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Updated VIF entry in instance network info cache for port 1f8e9d05-5a62-464d-b697-2a8210d318b4. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-472cef44-b62c-4e3a-9ddb-3070499047c6 req-d73347cb-f3a3-4c17-b9b1-ac586e4545cc service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Updating instance_info_cache with network_info: [{"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-472cef44-b62c-4e3a-9ddb-3070499047c6 req-d73347cb-f3a3-4c17-b9b1-ac586e4545cc service nova] Releasing lock "refresh_cache-0320a429-4c17-4337-a3c4-e6e806cf5305" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617 --force-share --output=json" returned: 0 in 0.214s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.objects.instance [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'migration_context' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:28 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Rebasing disk image.
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 -F raw /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:28 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Instance destroyed successfully.
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.objects.instance [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'resources' on Instance uuid 0320a429-4c17-4337-a3c4-e6e806cf5305 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:28 user nova-compute[73007]: INFO nova.compute.manager [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Terminating instance
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:45:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1228364702',display_name='tempest-AttachVolumeNegativeTest-server-1228364702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1228364702',id=13,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdqgngqPeeyp06wghXoKT8b8/K2OWHH/kYbvrD6stGmkHwXG7rR+T1Yuiq1q7jBenMLC3x8cnEGaPKPzinCLPjExNjFM1E4Zz1od2jsC/LN3vqwowrfKmbV8SxLzHp0GQ==',key_name='tempest-keypair-192588234',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-1z7l8no0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=0320a429-4c17-4337-a3c4-e6e806cf5305,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "address": "fa:16:3e:22:ee:35", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f8e9d05-5a", "ovs_interfaceid": "1f8e9d05-5a62-464d-b697-2a8210d318b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ee:35,bridge_name='br-int',has_traffic_filtering=True,id=1f8e9d05-5a62-464d-b697-2a8210d318b4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e9d05-5a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG os_vif [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ee:35,bridge_name='br-int',has_traffic_filtering=True,id=1f8e9d05-5a62-464d-b697-2a8210d318b4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e9d05-5a') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f8e9d05-5a, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:28 user nova-compute[73007]: INFO os_vif [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ee:35,bridge_name='br-int',has_traffic_filtering=True,id=1f8e9d05-5a62-464d-b697-2a8210d318b4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f8e9d05-5a')
Aug 15 17:47:28 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Deleting instance files /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305_del
Aug 15 17:47:28 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Deletion of /opt/stack/data/nova/instances/0320a429-4c17-4337-a3c4-e6e806cf5305_del complete
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:28 user nova-compute[73007]: INFO nova.compute.manager [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 15 17:47:28 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPnHkcZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.630s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== connect_volume: return (1631ms) {'type': 'block', 'scsi_wwn': '26566323562343031', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566323562343031', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'pci_devices' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:47:29 user nova-compute[73007]:   <uuid>42c38120-5e1d-4438-a53b-8a188e417c91</uuid>
Aug 15 17:47:29 user nova-compute[73007]:   <name>instance-00000004</name>
Aug 15 17:47:29 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:47:29 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:47:29 user nova-compute[73007]:   <metadata>
Aug 15 17:47:29 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:47:29 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:47:29 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeTestJSON-server-1553936509</nova:name>
Aug 15 17:47:29 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:47:27</nova:creationTime>
Aug 15 17:47:29 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:47:29 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:47:29 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:47:29 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:47:29 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:47:29 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:47:29 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:47:29 user nova-compute[73007]:       <nova:owner>
Aug 15 17:47:29 user nova-compute[73007]:         <nova:user uuid="1395246c93fc4c0dac8d95fffefd9711">tempest-AttachVolumeTestJSON-1742996205-project-member</nova:user>
Aug 15 17:47:29 user nova-compute[73007]:         <nova:project uuid="e1deb9da1fb54f8b8968f01265347c48">tempest-AttachVolumeTestJSON-1742996205</nova:project>
Aug 15 17:47:29 user nova-compute[73007]:       </nova:owner>
Aug 15 17:47:29 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:47:29 user nova-compute[73007]:       <nova:ports>
Aug 15 17:47:29 user nova-compute[73007]:         <nova:port uuid="2c926c8a-890e-40cf-b2c4-906f890e4791">
Aug 15 17:47:29 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 17:47:29 user nova-compute[73007]:         </nova:port>
Aug 15 17:47:29 user nova-compute[73007]:       </nova:ports>
Aug 15 17:47:29 user nova-compute[73007]:     </nova:instance>
Aug 15 17:47:29 user nova-compute[73007]:   </metadata>
Aug 15 17:47:29 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:47:29 user nova-compute[73007]:     <system>
Aug 15 17:47:29 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:47:29 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:47:29 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:47:29 user nova-compute[73007]:       <entry name="serial">42c38120-5e1d-4438-a53b-8a188e417c91</entry>
Aug 15 17:47:29 user nova-compute[73007]:       <entry name="uuid">42c38120-5e1d-4438-a53b-8a188e417c91</entry>
Aug 15 17:47:29 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:47:29 user nova-compute[73007]:     </system>
Aug 15 17:47:29 user nova-compute[73007]:   </sysinfo>
Aug 15 17:47:29 user nova-compute[73007]:   <os>
Aug 15 17:47:29 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:47:29 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:47:29 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:47:29 user nova-compute[73007]:   </os>
Aug 15 17:47:29 user nova-compute[73007]:   <features>
Aug 15 17:47:29 user nova-compute[73007]:     <acpi/>
Aug 15 17:47:29 user nova-compute[73007]:     <apic/>
Aug 15 17:47:29 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:47:29 user nova-compute[73007]:   </features>
Aug 15 17:47:29 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:47:29 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:47:29 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:47:29 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:47:29 user nova-compute[73007]:   </clock>
Aug 15 17:47:29 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:47:29 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:47:29 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:47:29 user nova-compute[73007]:   </cpu>
Aug 15 17:47:29 user nova-compute[73007]:   <devices>
Aug 15 17:47:29 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:47:29 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:47:29 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk"/>
Aug 15 17:47:29 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:47:29 user nova-compute[73007]:     </disk>
Aug 15 17:47:29 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:47:29 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:47:29 user nova-compute[73007]:       <source dev="/dev/sdd"/>
Aug 15 17:47:29 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:47:29 user nova-compute[73007]:       <serial>71574eb8-e7fd-402a-8b17-9d8fee4997ff</serial>
Aug 15 17:47:29 user nova-compute[73007]:     </disk>
Aug 15 17:47:29 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:47:29 user nova-compute[73007]:       <mac address="fa:16:3e:4c:f4:0a"/>
Aug 15 17:47:29 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:47:29 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:47:29 user nova-compute[73007]:       <target dev="tap2c926c8a-89"/>
Aug 15 17:47:29 user nova-compute[73007]:     </interface>
Aug 15 17:47:29 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:47:29 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/console.log" append="off"/>
Aug 15 17:47:29 user nova-compute[73007]:     </serial>
Aug 15 17:47:29 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:47:29 user nova-compute[73007]:     <video>
Aug 15 17:47:29 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:47:29 user nova-compute[73007]:     </video>
Aug 15 17:47:29 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:47:29 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:47:29 user nova-compute[73007]:     </rng>
Aug 15 17:47:29 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:47:29 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:47:29 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:47:29 user nova-compute[73007]:     </memballoon>
Aug 15 17:47:29 user nova-compute[73007]:   </devices>
Aug 15 17:47:29 user nova-compute[73007]: </domain>
Aug 15 17:47:29 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received event network-vif-unplugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] Acquiring lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] No waiting events found dispatching network-vif-unplugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received event network-vif-unplugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received event network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] Acquiring lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] No waiting events found dispatching network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:29 user nova-compute[73007]: WARNING nova.compute.manager [req-1ab6e572-25d8-47e0-8059-78f05600a878 req-bdfab43a-f26b-46d6-8541-c99530ed30fd service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received unexpected event network-vif-plugged-1f8e9d05-5a62-464d-b697-2a8210d318b4 for instance with vm_state active and task_state deleting.
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:29 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Instance destroyed successfully.
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.objects.instance [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lazy-loading 'resources' on Instance uuid 76bc99a0-7be4-480c-a7b1-11a9a557c645 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-636727005',display_name='tempest-TestVolumeSwap-server-636727005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-636727005',id=9,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6KapPTAyyGXNdxYWp6xUMbDIDnIykEpDLmuzAO9f0KNS5CgUXVQ35uHIduxFoUraun6bIye+dJppzvBzlFQITwDlcehCBKPreHI1v5gZvAJsx2C3NplIR/5ZymMRuVDg==',key_name='tempest-keypair-764214141',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:44:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba216cdf4d404ba3b546cf6448c2021c',ramdisk_id='',reservation_id='r-9rbtonrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1158068750',owner_user_name='tempest-TestVolumeSwap-1158068750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:44:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23832aa9aff9406b916174bcbdb8ed25',uuid=76bc99a0-7be4-480c-a7b1-11a9a557c645,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Converting VIF {"id": "722e7669-c824-4ee0-97d6-b048c1000c74", "address": "fa:16:3e:1c:70:34", "network": {"id": "03af24bc-ef5e-4416-8f90-63fa29f0acc3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1277095980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba216cdf4d404ba3b546cf6448c2021c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap722e7669-c8", "ovs_interfaceid": "722e7669-c824-4ee0-97d6-b048c1000c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:70:34,bridge_name='br-int',has_traffic_filtering=True,id=722e7669-c824-4ee0-97d6-b048c1000c74,network=Network(03af24bc-ef5e-4416-8f90-63fa29f0acc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap722e7669-c8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG os_vif [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:70:34,bridge_name='br-int',has_traffic_filtering=True,id=722e7669-c824-4ee0-97d6-b048c1000c74,network=Network(03af24bc-ef5e-4416-8f90-63fa29f0acc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap722e7669-c8') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap722e7669-c8, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:29 user nova-compute[73007]: INFO os_vif [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:70:34,bridge_name='br-int',has_traffic_filtering=True,id=722e7669-c824-4ee0-97d6-b048c1000c74,network=Network(03af24bc-ef5e-4416-8f90-63fa29f0acc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap722e7669-c8')
Aug 15 17:47:29 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Deleting instance files /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645_del
Aug 15 17:47:29 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Deletion of /opt/stack/data/nova/instances/76bc99a0-7be4-480c-a7b1-11a9a557c645_del complete
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:29 user nova-compute[73007]: INFO nova.compute.manager [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-07ff6270-8857-416a-88ec-39a08bc94b24 req-0e4e989c-2c9d-40cb-b2c3-ed9f6ede52a4 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received event network-vif-unplugged-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-07ff6270-8857-416a-88ec-39a08bc94b24 req-0e4e989c-2c9d-40cb-b2c3-ed9f6ede52a4 service nova] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-07ff6270-8857-416a-88ec-39a08bc94b24 req-0e4e989c-2c9d-40cb-b2c3-ed9f6ede52a4 service nova] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-07ff6270-8857-416a-88ec-39a08bc94b24 req-0e4e989c-2c9d-40cb-b2c3-ed9f6ede52a4 service nova] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-07ff6270-8857-416a-88ec-39a08bc94b24 req-0e4e989c-2c9d-40cb-b2c3-ed9f6ede52a4 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] No waiting events found dispatching network-vif-unplugged-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-07ff6270-8857-416a-88ec-39a08bc94b24 req-0e4e989c-2c9d-40cb-b2c3-ed9f6ede52a4 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received event network-vif-unplugged-722e7669-c824-4ee0-97d6-b048c1000c74 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.227s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:47:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Cannot resize image /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG nova.objects.instance [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'migration_context' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG os_vif [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c926c8a-89, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c926c8a-89, col_values=(('external_ids', {'iface-id': '2c926c8a-890e-40cf-b2c4-906f890e4791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:f4:0a', 'vm-uuid': '42c38120-5e1d-4438-a53b-8a188e417c91'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:30 user nova-compute[73007]: INFO os_vif [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89')
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 -F raw /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk" returned: 0 in 3.252s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Ensure instance console log exists: /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Start _get_guest_xml network_info=[{"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='20ff163f2986239c1d12ec4a3b50f4b8',container_format='bare',created_at=2023-08-15T17:45:18Z,direct_url=<?>,disk_format='qcow2',id=2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-808387531-shelved',owner='4727295cc556413eb5dd6ca0d10f50e7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T17:45:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEbSsHDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a82e6742-fe31-4693-8db5-50dc97f6072c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd97f2255-077f-4b8e-88a5-d5ded468448b', 'serial': 'd97f2255-077f-4b8e-88a5-d5ded468448b'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '8abab581-2c8c-43c1-ac53-0a1978641a74', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:47:31 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Took 2.78 seconds to deallocate network for instance.
Aug 15 17:47:31 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:31 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='20ff163f2986239c1d12ec4a3b50f4b8',container_format='bare',created_at=2023-08-15T17:45:18Z,direct_url=<?>,disk_format='qcow2',id=2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-808387531-shelved',owner='4727295cc556413eb5dd6ca0d10f50e7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T17:45:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.objects.instance [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'vcpu_model' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEbSsHDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:31 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:31 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:31 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a1713-a94e-4896-a9b7-c445fdcee3d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:47:31 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:31 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Took 2.16 seconds to deallocate network for instance.
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7326bcd2-813e-41f3-ae48-e2e8956dd7ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b] added
Aug 15 17:47:31 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ce55b4-1e3c-4823-aac1-de745ea85bfb]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ea08b8-f94f-4217-b09e-eb55f1d28f7a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-36002797-9beb-4162-b567-998c9f158138 req-b025d5d5-b291-4c6a-afd6-676f5ad6cf32 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received event network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36002797-9beb-4162-b567-998c9f158138 req-b025d5d5-b291-4c6a-afd6-676f5ad6cf32 service nova] Acquiring lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36002797-9beb-4162-b567-998c9f158138 req-b025d5d5-b291-4c6a-afd6-676f5ad6cf32 service nova] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36002797-9beb-4162-b567-998c9f158138 req-b025d5d5-b291-4c6a-afd6-676f5ad6cf32 service nova] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-36002797-9beb-4162-b567-998c9f158138 req-b025d5d5-b291-4c6a-afd6-676f5ad6cf32 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] No waiting events found dispatching network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:32 user nova-compute[73007]: WARNING nova.compute.manager [req-36002797-9beb-4162-b567-998c9f158138 req-b025d5d5-b291-4c6a-afd6-676f5ad6cf32 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received unexpected event network-vif-plugged-722e7669-c824-4ee0-97d6-b048c1000c74 for instance with vm_state active and task_state deleting.
Aug 15 17:47:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-36002797-9beb-4162-b567-998c9f158138 req-b025d5d5-b291-4c6a-afd6-676f5ad6cf32 service nova] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Received event network-vif-deleted-1f8e9d05-5a62-464d-b697-2a8210d318b4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-36002797-9beb-4162-b567-998c9f158138 req-b025d5d5-b291-4c6a-afd6-676f5ad6cf32 service nova] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Received event network-vif-deleted-722e7669-c824-4ee0-97d6-b048c1000c74 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PEbSsHDY {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PEbSsHDY" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f3db5b-3319-4954-a3d7-ad05f23de58b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PEbSsHDY'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5326e10-3bd4-471a-913e-58332d5ebf3e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2846589b-c7b7-4f78-a272-7ec80a068b15]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde15a3-9461-4949-afcd-32343b71470b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b, portal: 172.16.0.220,3260]
Aug 15 17:47:32 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b, portal: 172.16.0.220,3260] successful.
Aug 15 17:47:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[40836dc8-1cb2-4316-9e1d-33424be68d5f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[582b0f08-55ac-4104-891d-35d6632c69d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.035s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[32512f68-0079-4838-8adf-da339d7f17ee]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEbSsHDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.450s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:32 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Deleted allocations for instance 0320a429-4c17-4337-a3c4-e6e806cf5305
Aug 15 17:47:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-97257cf7-9526-4b02-8630-ade62b95a1fe tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "0320a429-4c17-4337-a3c4-e6e806cf5305" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.753s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.645s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:33 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Deleted allocations for instance 76bc99a0-7be4-480c-a7b1-11a9a557c645
Aug 15 17:47:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fd363da8-ca82-4152-8401-e8a6e22ae6f5 tempest-TestVolumeSwap-1158068750 tempest-TestVolumeSwap-1158068750-project-member] Lock "76bc99a0-7be4-480c-a7b1-11a9a557c645" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.496s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.519s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] <== connect_volume: return (1520ms) {'type': 'block', 'scsi_wwn': '26332636632366563', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332636632366563', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-808387531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-808387531',id=2,image_ref='2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-21307621',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-p93ff0q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member',shelved_at='2023-08-15T17:45:22.176512',shelved_host='user',shelved_image_id='2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:47:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=a82e6742-fe31-4693-8db5-50dc97f6072c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'pci_devices' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:47:33 user nova-compute[73007]:   <uuid>a82e6742-fe31-4693-8db5-50dc97f6072c</uuid>
Aug 15 17:47:33 user nova-compute[73007]:   <name>instance-00000002</name>
Aug 15 17:47:33 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:47:33 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:47:33 user nova-compute[73007]:   <metadata>
Aug 15 17:47:33 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:47:33 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:47:33 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-808387531</nova:name>
Aug 15 17:47:33 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:47:31</nova:creationTime>
Aug 15 17:47:33 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:47:33 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:47:33 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:47:33 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:47:33 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:47:33 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:47:33 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:47:33 user nova-compute[73007]:       <nova:owner>
Aug 15 17:47:33 user nova-compute[73007]:         <nova:user uuid="206f089e51fd4e8f842a5584b630c736">tempest-AttachVolumeShelveTestJSON-1726690631-project-member</nova:user>
Aug 15 17:47:33 user nova-compute[73007]:         <nova:project uuid="4727295cc556413eb5dd6ca0d10f50e7">tempest-AttachVolumeShelveTestJSON-1726690631</nova:project>
Aug 15 17:47:33 user nova-compute[73007]:       </nova:owner>
Aug 15 17:47:33 user nova-compute[73007]:       <nova:root type="image" uuid="2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d"/>
Aug 15 17:47:33 user nova-compute[73007]:       <nova:ports>
Aug 15 17:47:33 user nova-compute[73007]:         <nova:port uuid="ddf68e4b-1015-4964-9b62-d41585fd04fc">
Aug 15 17:47:33 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 17:47:33 user nova-compute[73007]:         </nova:port>
Aug 15 17:47:33 user nova-compute[73007]:       </nova:ports>
Aug 15 17:47:33 user nova-compute[73007]:     </nova:instance>
Aug 15 17:47:33 user nova-compute[73007]:   </metadata>
Aug 15 17:47:33 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:47:33 user nova-compute[73007]:     <system>
Aug 15 17:47:33 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:47:33 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:47:33 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:47:33 user nova-compute[73007]:       <entry name="serial">a82e6742-fe31-4693-8db5-50dc97f6072c</entry>
Aug 15 17:47:33 user nova-compute[73007]:       <entry name="uuid">a82e6742-fe31-4693-8db5-50dc97f6072c</entry>
Aug 15 17:47:33 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:47:33 user nova-compute[73007]:     </system>
Aug 15 17:47:33 user nova-compute[73007]:   </sysinfo>
Aug 15 17:47:33 user nova-compute[73007]:   <os>
Aug 15 17:47:33 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:47:33 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:47:33 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:47:33 user nova-compute[73007]:   </os>
Aug 15 17:47:33 user nova-compute[73007]:   <features>
Aug 15 17:47:33 user nova-compute[73007]:     <acpi/>
Aug 15 17:47:33 user nova-compute[73007]:     <apic/>
Aug 15 17:47:33 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:47:33 user nova-compute[73007]:   </features>
Aug 15 17:47:33 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:47:33 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:47:33 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:47:33 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:47:33 user nova-compute[73007]:   </clock>
Aug 15 17:47:33 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:47:33 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:47:33 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:47:33 user nova-compute[73007]:   </cpu>
Aug 15 17:47:33 user nova-compute[73007]:   <devices>
Aug 15 17:47:33 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:47:33 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:47:33 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk"/>
Aug 15 17:47:33 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:47:33 user nova-compute[73007]:     </disk>
Aug 15 17:47:33 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:47:33 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:47:33 user nova-compute[73007]:       <source dev="/dev/sde"/>
Aug 15 17:47:33 user nova-compute[73007]:       <target dev="vdc" bus="virtio"/>
Aug 15 17:47:33 user nova-compute[73007]:       <serial>d97f2255-077f-4b8e-88a5-d5ded468448b</serial>
Aug 15 17:47:33 user nova-compute[73007]:     </disk>
Aug 15 17:47:33 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:47:33 user nova-compute[73007]:       <mac address="fa:16:3e:2e:2c:d6"/>
Aug 15 17:47:33 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:47:33 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:47:33 user nova-compute[73007]:       <target dev="tapddf68e4b-10"/>
Aug 15 17:47:33 user nova-compute[73007]:     </interface>
Aug 15 17:47:33 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:47:33 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/console.log" append="off"/>
Aug 15 17:47:33 user nova-compute[73007]:     </serial>
Aug 15 17:47:33 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:47:33 user nova-compute[73007]:     <video>
Aug 15 17:47:33 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:47:33 user nova-compute[73007]:     </video>
Aug 15 17:47:33 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:47:33 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:47:33 user nova-compute[73007]:     </rng>
Aug 15 17:47:33 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:47:33 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:47:33 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:47:33 user nova-compute[73007]:     </memballoon>
Aug 15 17:47:33 user nova-compute[73007]:   </devices>
Aug 15 17:47:33 user nova-compute[73007]: </domain>
Aug 15 17:47:33 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-808387531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-808387531',id=2,image_ref='2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-21307621',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-p93ff0q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member',shelved_at='2023-08-15T17:45:22.176512',shelved_host='user',shelved_image_id='2b70b9cf-da2e-4906-bcf1-97f3a34e4e9d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:47:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=a82e6742-fe31-4693-8db5-50dc97f6072c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG os_vif [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddf68e4b-10, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapddf68e4b-10, col_values=(('external_ids', {'iface-id': 'ddf68e4b-1015-4964-9b62-d41585fd04fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:2c:d6', 'vm-uuid': 'a82e6742-fe31-4693-8db5-50dc97f6072c'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: INFO os_vif [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10')
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-25191540-6277-4b5a-893b-da203a2e0521 req-47d35f21-0f06-4fb9-803a-4ca6d03c4715 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-25191540-6277-4b5a-893b-da203a2e0521 req-47d35f21-0f06-4fb9-803a-4ca6d03c4715 service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-25191540-6277-4b5a-893b-da203a2e0521 req-47d35f21-0f06-4fb9-803a-4ca6d03c4715 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-25191540-6277-4b5a-893b-da203a2e0521 req-47d35f21-0f06-4fb9-803a-4ca6d03c4715 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-25191540-6277-4b5a-893b-da203a2e0521 req-47d35f21-0f06-4fb9-803a-4ca6d03c4715 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:33 user nova-compute[73007]: WARNING nova.compute.manager [req-25191540-6277-4b5a-893b-da203a2e0521 req-47d35f21-0f06-4fb9-803a-4ca6d03c4715 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state stopped and task_state powering-on.
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No VIF found with MAC fa:16:3e:2e:2c:d6, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:47:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-733da6f5-4546-42d4-8a5d-e8e86bc8d9a7 req-97af5468-853d-4c32-93ca-3f0f3a512dc1 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-733da6f5-4546-42d4-8a5d-e8e86bc8d9a7 req-97af5468-853d-4c32-93ca-3f0f3a512dc1 service nova] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-733da6f5-4546-42d4-8a5d-e8e86bc8d9a7 req-97af5468-853d-4c32-93ca-3f0f3a512dc1 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-733da6f5-4546-42d4-8a5d-e8e86bc8d9a7 req-97af5468-853d-4c32-93ca-3f0f3a512dc1 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-733da6f5-4546-42d4-8a5d-e8e86bc8d9a7 req-97af5468-853d-4c32-93ca-3f0f3a512dc1 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] No waiting events found dispatching network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:35 user nova-compute[73007]: WARNING nova.compute.manager [req-733da6f5-4546-42d4-8a5d-e8e86bc8d9a7 req-97af5468-853d-4c32-93ca-3f0f3a512dc1 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received unexpected event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-5e559532-c0d0-4707-96dd-0c0a95227554 req-0368d9fd-3acf-4470-bb0f-1c73464951c3 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5e559532-c0d0-4707-96dd-0c0a95227554 req-0368d9fd-3acf-4470-bb0f-1c73464951c3 service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5e559532-c0d0-4707-96dd-0c0a95227554 req-0368d9fd-3acf-4470-bb0f-1c73464951c3 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5e559532-c0d0-4707-96dd-0c0a95227554 req-0368d9fd-3acf-4470-bb0f-1c73464951c3 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-5e559532-c0d0-4707-96dd-0c0a95227554 req-0368d9fd-3acf-4470-bb0f-1c73464951c3 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:35 user nova-compute[73007]: WARNING nova.compute.manager [req-5e559532-c0d0-4707-96dd-0c0a95227554 req-0368d9fd-3acf-4470-bb0f-1c73464951c3 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state stopped and task_state powering-on.
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121655.8208542, 42c38120-5e1d-4438-a53b-8a188e417c91 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Resumed (Lifecycle Event)
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:47:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance rebooted successfully.
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-77e18d12-944f-4eaf-a5d0-c6f13b2ae293 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:47:36 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 17:47:36 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121655.8269799, 42c38120-5e1d-4438-a53b-8a188e417c91 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:36 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Started (Lifecycle Event)
Aug 15 17:47:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:47:36 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 17:47:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-dcad6853-e420-4058-b3e3-1f8e48c27de1 req-dc417ebe-c8db-4188-b7a5-bac1e5265987 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dcad6853-e420-4058-b3e3-1f8e48c27de1 req-dc417ebe-c8db-4188-b7a5-bac1e5265987 service nova] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dcad6853-e420-4058-b3e3-1f8e48c27de1 req-dc417ebe-c8db-4188-b7a5-bac1e5265987 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dcad6853-e420-4058-b3e3-1f8e48c27de1 req-dc417ebe-c8db-4188-b7a5-bac1e5265987 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-dcad6853-e420-4058-b3e3-1f8e48c27de1 req-dc417ebe-c8db-4188-b7a5-bac1e5265987 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] No waiting events found dispatching network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:37 user nova-compute[73007]: WARNING nova.compute.manager [req-dcad6853-e420-4058-b3e3-1f8e48c27de1 req-dc417ebe-c8db-4188-b7a5-bac1e5265987 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received unexpected event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121658.1496806, a82e6742-fe31-4693-8db5-50dc97f6072c => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] VM Resumed (Lifecycle Event)
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:38 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance spawned successfully.
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:47:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121658.1613057, a82e6742-fe31-4693-8db5-50dc97f6072c => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] VM Started (Lifecycle Event)
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:47:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:47:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-35b00cd3-0687-4c49-92ac-62b38ff08b82 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 27.098s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-a72f5af0-67a1-4d54-8587-c04b3650a8f7 req-1b5d75ac-60ec-4140-84ad-27a6ad555659 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-changed-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-a72f5af0-67a1-4d54-8587-c04b3650a8f7 req-1b5d75ac-60ec-4140-84ad-27a6ad555659 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing instance network info cache due to event network-changed-512fb710-a869-4764-aabc-a5589e500850. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a72f5af0-67a1-4d54-8587-c04b3650a8f7 req-1b5d75ac-60ec-4140-84ad-27a6ad555659 service nova] Acquiring lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a72f5af0-67a1-4d54-8587-c04b3650a8f7 req-1b5d75ac-60ec-4140-84ad-27a6ad555659 service nova] Acquired lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG nova.network.neutron [req-a72f5af0-67a1-4d54-8587-c04b3650a8f7 req-1b5d75ac-60ec-4140-84ad-27a6ad555659 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Refreshing network info cache for port 512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:41 user nova-compute[73007]: INFO nova.compute.manager [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Detaching volume 1f098273-a558-488d-b3b7-6b8837f2aa71
Aug 15 17:47:41 user nova-compute[73007]: INFO nova.virt.block_device [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Attempting to driver detach volume 1f098273-a558-488d-b3b7-6b8837f2aa71 from mountpoint /dev/vdb
Aug 15 17:47:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Attempting to detach device vdb from instance 92002335-4c3a-4d9b-ba90-f1840c9142b5 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:47:41 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:47:41 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:47:41 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:47:41 user nova-compute[73007]:   <serial>1f098273-a558-488d-b3b7-6b8837f2aa71</serial>
Aug 15 17:47:41 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:47:41 user nova-compute[73007]: </disk>
Aug 15 17:47:41 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:47:41 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Successfully detached device vdb from instance 92002335-4c3a-4d9b-ba90-f1840c9142b5 from the persistent domain config.
Aug 15 17:47:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92002335-4c3a-4d9b-ba90-f1840c9142b5 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:47:41 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:47:41 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:47:41 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:47:41 user nova-compute[73007]:   <serial>1f098273-a558-488d-b3b7-6b8837f2aa71</serial>
Aug 15 17:47:41 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:47:41 user nova-compute[73007]: </disk>
Aug 15 17:47:41 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:47:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121662.5145757, 92002335-4c3a-4d9b-ba90-f1840c9142b5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92002335-4c3a-4d9b-ba90-f1840c9142b5 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:47:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Successfully detached device vdb from instance 92002335-4c3a-4d9b-ba90-f1840c9142b5 from the live domain config.
Aug 15 17:47:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBsGzIkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eeedcf-0a43-4d38-9993-691f1760d800]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a2259-4627-47d5-905d-1fbc9782505a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:42 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7e75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[083e4d9b-0398-4594-a6f3-0629de3a820f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f98c19a-f9ad-4f3e-ba0e-043a8d0e94c6]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f071e3-e6ec-46ae-849e-a8323beaeae5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe774d4d-02bd-46cc-88ad-181f9503093b]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3470bc15-e176-4ee4-aaa9-b1a04bdb80d5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3fcd32-7459-49e0-81e4-aad3d718f9e8]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71, portal: 172.16.0.220,3260]
Aug 15 17:47:42 user nova-compute[73007]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71, portal: 172.16.0.220,3260] successful.
Aug 15 17:47:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[350adbea-c5e9-4d95-a9d9-ffdb9991d047]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] <== disconnect_volume: return (410ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:47:43 user nova-compute[73007]: DEBUG nova.network.neutron [req-a72f5af0-67a1-4d54-8587-c04b3650a8f7 req-1b5d75ac-60ec-4140-84ad-27a6ad555659 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updated VIF entry in instance network info cache for port 512fb710-a869-4764-aabc-a5589e500850. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:47:43 user nova-compute[73007]: DEBUG nova.network.neutron [req-a72f5af0-67a1-4d54-8587-c04b3650a8f7 req-1b5d75ac-60ec-4140-84ad-27a6ad555659 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a72f5af0-67a1-4d54-8587-c04b3650a8f7 req-1b5d75ac-60ec-4140-84ad-27a6ad555659 service nova] Releasing lock "refresh_cache-e90005bb-24fc-4f17-9189-50b8ebd906ad" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:47:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:43 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121648.6827729, 0320a429-4c17-4337-a3c4-e6e806cf5305 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:43 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] VM Stopped (Lifecycle Event)
Aug 15 17:47:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50a3d152-251b-49ed-9842-7715b72d429a None None] [instance: 0320a429-4c17-4337-a3c4-e6e806cf5305] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'flavor' on Instance uuid 92002335-4c3a-4d9b-ba90-f1840c9142b5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4ff745e4-5352-4ca4-a273-958a953e5367 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.319s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.112s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:44 user nova-compute[73007]: INFO nova.compute.manager [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Terminating instance
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:44 user nova-compute[73007]: INFO nova.compute.manager [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Terminating instance
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-b54bca2c-07e3-4476-9434-4176dc7ae10c req-b0b43ee7-df21-4ca9-8733-9dd3546d4b13 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received event network-vif-unplugged-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b54bca2c-07e3-4476-9434-4176dc7ae10c req-b0b43ee7-df21-4ca9-8733-9dd3546d4b13 service nova] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b54bca2c-07e3-4476-9434-4176dc7ae10c req-b0b43ee7-df21-4ca9-8733-9dd3546d4b13 service nova] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b54bca2c-07e3-4476-9434-4176dc7ae10c req-b0b43ee7-df21-4ca9-8733-9dd3546d4b13 service nova] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-b54bca2c-07e3-4476-9434-4176dc7ae10c req-b0b43ee7-df21-4ca9-8733-9dd3546d4b13 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] No waiting events found dispatching network-vif-unplugged-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-b54bca2c-07e3-4476-9434-4176dc7ae10c req-b0b43ee7-df21-4ca9-8733-9dd3546d4b13 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received event network-vif-unplugged-1f124901-40ef-497d-9479-7bb22833f3d4 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121649.5635006, 76bc99a0-7be4-480c-a7b1-11a9a557c645 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:44 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] VM Stopped (Lifecycle Event)
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b08d6fb3-ce6a-4568-8920-7800c6c931fe None None] [instance: 76bc99a0-7be4-480c-a7b1-11a9a557c645] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-1097c411-3fb5-4156-af14-d13b0f6b1bca req-c6468b7c-04a0-40ad-9bf0-6f7dfca02e8f service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1097c411-3fb5-4156-af14-d13b0f6b1bca req-c6468b7c-04a0-40ad-9bf0-6f7dfca02e8f service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1097c411-3fb5-4156-af14-d13b0f6b1bca req-c6468b7c-04a0-40ad-9bf0-6f7dfca02e8f service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1097c411-3fb5-4156-af14-d13b0f6b1bca req-c6468b7c-04a0-40ad-9bf0-6f7dfca02e8f service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-1097c411-3fb5-4156-af14-d13b0f6b1bca req-c6468b7c-04a0-40ad-9bf0-6f7dfca02e8f service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-unplugged-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-1097c411-3fb5-4156-af14-d13b0f6b1bca req-c6468b7c-04a0-40ad-9bf0-6f7dfca02e8f service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-512fb710-a869-4764-aabc-a5589e500850 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Instance destroyed successfully.
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'resources' on Instance uuid 92002335-4c3a-4d9b-ba90-f1840c9142b5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-468230397',display_name='tempest-VolumesSnapshotTestJSON-instance-468230397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-468230397',id=11,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4Y0vApS55kpTjDmOgtwA+fVARncQ+iiQitvemDqkqUHFTTvnG4jx3VywjSmRJyKcdxwzWdYA1soyJhXFA59hMyUpzrrrgIClB9Dm9eb9Vyd5A9hU8EXzc0P3eqe1m1+g==',key_name='tempest-keypair-958649484',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:44:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dac3717304e944b3b364bc599eb8e0bc',ramdisk_id='',reservation_id='r-5fn7a604',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1500133320',owner_user_name='tempest-VolumesSnapshotTestJSON-1500133320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:44:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b107f48a8a614494a0431c38e37f79f6',uuid=92002335-4c3a-4d9b-ba90-f1840c9142b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converting VIF {"id": "1f124901-40ef-497d-9479-7bb22833f3d4", "address": "fa:16:3e:16:1f:7c", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f124901-40", "ovs_interfaceid": "1f124901-40ef-497d-9479-7bb22833f3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:1f:7c,bridge_name='br-int',has_traffic_filtering=True,id=1f124901-40ef-497d-9479-7bb22833f3d4,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f124901-40') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG os_vif [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:1f:7c,bridge_name='br-int',has_traffic_filtering=True,id=1f124901-40ef-497d-9479-7bb22833f3d4,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f124901-40') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f124901-40, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: INFO os_vif [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:1f:7c,bridge_name='br-int',has_traffic_filtering=True,id=1f124901-40ef-497d-9479-7bb22833f3d4,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f124901-40')
Aug 15 17:47:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBsGzIkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:45 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f098273-a558-488d-b3b7-6b8837f2aa71', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca9bb39-0df5-47f8-b8bb-8ffb87a8b726]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[79404192-7a25-4311-9eb7-445d767c9fe5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:45 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7e2560>, {}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Disconnecting from: [] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] <== disconnect_volume: return (86ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:47:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Deleting instance files /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5_del
Aug 15 17:47:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Deletion of /opt/stack/data/nova/instances/92002335-4c3a-4d9b-ba90-f1840c9142b5_del complete
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-a6fd221e-c9db-41f3-9d43-0d245764992d req-93249c4b-5df7-473f-b862-f92fb9c202d8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a6fd221e-c9db-41f3-9d43-0d245764992d req-93249c4b-5df7-473f-b862-f92fb9c202d8 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a6fd221e-c9db-41f3-9d43-0d245764992d req-93249c4b-5df7-473f-b862-f92fb9c202d8 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a6fd221e-c9db-41f3-9d43-0d245764992d req-93249c4b-5df7-473f-b862-f92fb9c202d8 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-a6fd221e-c9db-41f3-9d43-0d245764992d req-93249c4b-5df7-473f-b862-f92fb9c202d8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-unplugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-a6fd221e-c9db-41f3-9d43-0d245764992d req-93249c4b-5df7-473f-b862-f92fb9c202d8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: INFO nova.compute.manager [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 15 17:47:45 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received event network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] Acquiring lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] No waiting events found dispatching network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:46 user nova-compute[73007]: WARNING nova.compute.manager [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received unexpected event network-vif-plugged-1f124901-40ef-497d-9479-7bb22833f3d4 for instance with vm_state active and task_state deleting.
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-unplugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3571ad97-6632-4aca-b00e-f63db1561b86 req-da0c97d4-17ba-4e0e-9054-38192d18f8e0 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:46 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Instance destroyed successfully.
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lazy-loading 'resources' on Instance uuid e90005bb-24fc-4f17-9189-50b8ebd906ad {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:64:16,bridge_name='br-int',has_traffic_filtering=True,id=512fb710-a869-4764-aabc-a5589e500850,network=Network(2d52b81f-ab6c-47d0-86a0-62cb22357d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap512fb710-a8') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:64:16,bridge_name='br-int',has_traffic_filtering=True,id=512fb710-a869-4764-aabc-a5589e500850,network=Network(2d52b81f-ab6c-47d0-86a0-62cb22357d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap512fb710-a8') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap512fb710-a8, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: INFO os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:64:16,bridge_name='br-int',has_traffic_filtering=True,id=512fb710-a869-4764-aabc-a5589e500850,network=Network(2d52b81f-ab6c-47d0-86a0-62cb22357d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap512fb710-a8')
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3d:f0,bridge_name='br-int',has_traffic_filtering=True,id=c2ed06db-22e0-4601-a79a-fce4edb9d325,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2ed06db-22') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3d:f0,bridge_name='br-int',has_traffic_filtering=True,id=c2ed06db-22e0-4601-a79a-fce4edb9d325,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2ed06db-22') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2ed06db-22, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: INFO os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3d:f0,bridge_name='br-int',has_traffic_filtering=True,id=c2ed06db-22e0-4601-a79a-fce4edb9d325,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc2ed06db-22')
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fe:6a,bridge_name='br-int',has_traffic_filtering=True,id=e9359e36-f5a8-4f88-8375-2979cc99fa3a,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9359e36-f5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fe:6a,bridge_name='br-int',has_traffic_filtering=True,id=e9359e36-f5a8-4f88-8375-2979cc99fa3a,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9359e36-f5') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:46 user nova-compute[73007]: WARNING nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-512fb710-a869-4764-aabc-a5589e500850 for instance with vm_state active and task_state deleting.
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-unplugged-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-db8630a0-4d10-4051-9849-12f968c27580 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:46 user nova-compute[73007]: WARNING nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-db8630a0-4d10-4051-9849-12f968c27580 for instance with vm_state active and task_state deleting.
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-unplugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:46 user nova-compute[73007]: WARNING nova.compute.manager [req-0d297cb0-9e3d-42a7-bdc8-54c035b84a92 req-a1139394-d327-4749-9e55-266df66ecde7 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-f2dc89bb-161d-4512-a9b4-56c6f1156d93 for instance with vm_state active and task_state deleting.
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9359e36-f5, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:46 user nova-compute[73007]: INFO os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:fe:6a,bridge_name='br-int',has_traffic_filtering=True,id=e9359e36-f5a8-4f88-8375-2979cc99fa3a,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9359e36-f5')
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "address": "fa:16:3e:4f:ad:05", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95359884-3e", "ovs_interfaceid": "95359884-3e57-4e19-b56c-4ce0720f9d9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ad:05,bridge_name='br-int',has_traffic_filtering=True,id=95359884-3e57-4e19-b56c-4ce0720f9d9b,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95359884-3e') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:46 user nova-compute[73007]: DEBUG os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ad:05,bridge_name='br-int',has_traffic_filtering=True,id=95359884-3e57-4e19-b56c-4ce0720f9d9b,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95359884-3e') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95359884-3e, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: INFO os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:ad:05,bridge_name='br-int',has_traffic_filtering=True,id=95359884-3e57-4e19-b56c-4ce0720f9d9b,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95359884-3e')
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a9:b0,bridge_name='br-int',has_traffic_filtering=True,id=db8630a0-4d10-4051-9849-12f968c27580,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8630a0-4d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a9:b0,bridge_name='br-int',has_traffic_filtering=True,id=db8630a0-4d10-4051-9849-12f968c27580,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8630a0-4d') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb8630a0-4d, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: INFO os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a9:b0,bridge_name='br-int',has_traffic_filtering=True,id=db8630a0-4d10-4051-9849-12f968c27580,network=Network(33f0cdb0-cbc1-4238-859d-bdb2e7aa8612),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb8630a0-4d')
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:47,bridge_name='br-int',has_traffic_filtering=True,id=f2dc89bb-161d-4512-a9b4-56c6f1156d93,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dc89bb-16') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:47,bridge_name='br-int',has_traffic_filtering=True,id=f2dc89bb-161d-4512-a9b4-56c6f1156d93,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dc89bb-16') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2dc89bb-16, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: INFO os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f3:47,bridge_name='br-int',has_traffic_filtering=True,id=f2dc89bb-161d-4512-a9b4-56c6f1156d93,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2dc89bb-16')
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650407706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650407706',id=12,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzo3rdEFPSgrouw06px3tOU11brit7fIsK+n7LRctPL/d2vkRTPUXcHkyrzrqqlIs2tPFrpTpgbqyCBXkPrFfW5AGM5iYwL5peRZoXW8zump/4suq3Kvn6+T6eNQsT70g==',key_name='tempest-keypair-681651057',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='677e7d9c21cd4f6fa9df0b9249060855',ramdisk_id='',reservation_id='r-dxlbtux8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2121200936',owner_user_name='tempest-TaggedBootDevicesTest-2121200936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f59c9aec5ab24c6188ddf21c5af35d6c',uuid=e90005bb-24fc-4f17-9189-50b8ebd906ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converting VIF {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c0:35,bridge_name='br-int',has_traffic_filtering=True,id=7ec98d55-c39e-4aa1-9616-03f4d44bfb09,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec98d55-c3') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c0:35,bridge_name='br-int',has_traffic_filtering=True,id=7ec98d55-c39e-4aa1-9616-03f4d44bfb09,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec98d55-c3') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ec98d55-c3, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:47:47 user nova-compute[73007]: INFO os_vif [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c0:35,bridge_name='br-int',has_traffic_filtering=True,id=7ec98d55-c39e-4aa1-9616-03f4d44bfb09,network=Network(e18c5c64-48c9-4e13-9ca4-9f49bccce562),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ec98d55-c3')
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veLWcTkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:47 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fad083-f0a3-433e-a490-418a968e5094]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69eeb65-49cf-4191-8cb7-88ac68d24612]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1150154790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5'): ({'sdi'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Removing single pathed devices sdi {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e525f109-b381-428a-8920-171fa6de462c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a3c863-3f25-485e-bd2d-b977061bd5a4]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Flushing IO for device /dev/sdi {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f14ed93-647b-48e6-9779-f5a4f9c696cc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:47 user nova-compute[73007]: WARNING nova.compute.manager [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-c2ed06db-22e0-4601-a79a-fce4edb9d325 for instance with vm_state active and task_state deleting.
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-unplugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-dd362be5-a0aa-4db6-aaa2-c20992121ade req-6c0eaa44-23fe-4789-97a0-fce19aa73618 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.080s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2756d0-cc83-4bde-bd30-eee59aa697fd]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] SCSI volumes sdi have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7cbc1a-fd17-4526-958e-e10803150f41]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[712b33dc-0cfe-40d5-a2a9-004767a88177]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5, portal: 172.16.0.220,3260]
Aug 15 17:47:47 user nova-compute[73007]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5, portal: 172.16.0.220,3260] successful.
Aug 15 17:47:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d51e30c-12d9-4cea-85cd-8b09b0e8d7b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b200805-a43c-4371-9a32-fa466e78b56b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== disconnect_volume: return (417ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zfSPsLEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:47 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6647c6a-c75d-4242-a4d1-2a1373d3fba2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b766e904-1606-4495-9e9d-0bad9671175b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 (non-flash)
Aug 15 17:47:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1150154790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0'): ({'sdh'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Removing single pathed devices sdh {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a258be2b-8699-4ca1-8664-ee1830a01b23]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d72fd14-d6e8-4e4e-8d82-e3032b64810b]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Flushing IO for device /dev/sdh {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc56e1-3e1b-4744-af72-de8168bae569]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.066s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[81923279-cd85-4a08-bc3b-c13074496879]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] SCSI volumes sdh have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[82758592-ab70-477b-b49f-8092afaacfdf]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f941d5-3b28-4839-87e7-2b3ae9521478]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0, portal: 172.16.0.220,3260]
Aug 15 17:47:47 user nova-compute[73007]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0, portal: 172.16.0.220,3260] successful.
Aug 15 17:47:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b6dda10-4c1a-4ee7-b1d3-7c85583ee4a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf48f9f-5540-43cb-9e80-2c5886582c2c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== disconnect_volume: return (396ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWUjKZRx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:47:47 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:47:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cf1b50-a767-4b23-9a65-25c388d9e66b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0cd009-6ba6-40ad-9ef5-162b4165a5d2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:48 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:48 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:48 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:48 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:48 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:47:48 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:47:48 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:47:48 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:47:48 user nova-compute[73007]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 (non-flash)
Aug 15 17:47:48 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7b0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764'): ({'sdg'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Removing single pathed devices sdg {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51961d4-f77d-42c3-946a-6f3bdaae5951]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Took 2.77 seconds to deallocate network for instance.
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c55393-0a1a-4477-a5c6-405df1cd6557]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Flushing IO for device /dev/sdg {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: WARNING nova.volume.cinder [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Attachment d777fac7-c64e-433f-8d7f-f4cdd2e17381 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d777fac7-c64e-433f-8d7f-f4cdd2e17381. (HTTP 404) (Request-ID: req-0a7e4d4b-3ce5-457d-aa8f-8a888b74a2b8)
Aug 15 17:47:48 user nova-compute[73007]: INFO nova.compute.manager [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3562b60-83c4-464c-88d3-179b8028f758]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37dbe66-625d-47dc-a047-11836d168a0f]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] SCSI volumes sdg have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd6800f-02c5-4c87-a7d4-f763c3d4e123]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6789d9ca-f18e-402a-9269-212136c7fef1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764, portal: 172.16.0.220,3260]
Aug 15 17:47:48 user nova-compute[73007]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764, portal: 172.16.0.220,3260] successful.
Aug 15 17:47:48 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87980b2a-6193-4ef5-bd17-070e51a10764 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c009b68-cf89-4a36-b9cd-64cd2cf374b0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] <== disconnect_volume: return (339ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:47:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Deleting instance files /opt/stack/data/nova/instances/e90005bb-24fc-4f17-9189-50b8ebd906ad_del
Aug 15 17:47:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Deletion of /opt/stack/data/nova/instances/e90005bb-24fc-4f17-9189-50b8ebd906ad_del complete
Aug 15 17:47:48 user nova-compute[73007]: INFO nova.compute.manager [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Took 4.09 seconds to destroy the instance on the hypervisor.
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:48 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Deleted allocations for instance 92002335-4c3a-4d9b-ba90-f1840c9142b5
Aug 15 17:47:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8b45672f-7944-4103-952c-57dcc7684c31 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "92002335-4c3a-4d9b-ba90-f1840c9142b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.847s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:49 user nova-compute[73007]: WARNING nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-e9359e36-f5a8-4f88-8375-2979cc99fa3a for instance with vm_state active and task_state deleting.
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-unplugged-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-unplugged-95359884-3e57-4e19-b56c-4ce0720f9d9b for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:49 user nova-compute[73007]: WARNING nova.compute.manager [req-89c98f17-1ace-42c5-b2bf-e0b1b83f0e05 req-f2be1e99-d2bd-4630-9ce2-eb73dce554c8 service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-95359884-3e57-4e19-b56c-4ce0720f9d9b for instance with vm_state active and task_state deleting.
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-4be560be-ad3a-4fee-a6e0-6c4064a8bf24 req-d88a047b-209e-4f66-a0c9-4d2600e2161c service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4be560be-ad3a-4fee-a6e0-6c4064a8bf24 req-d88a047b-209e-4f66-a0c9-4d2600e2161c service nova] Acquiring lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4be560be-ad3a-4fee-a6e0-6c4064a8bf24 req-d88a047b-209e-4f66-a0c9-4d2600e2161c service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4be560be-ad3a-4fee-a6e0-6c4064a8bf24 req-d88a047b-209e-4f66-a0c9-4d2600e2161c service nova] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-4be560be-ad3a-4fee-a6e0-6c4064a8bf24 req-d88a047b-209e-4f66-a0c9-4d2600e2161c service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] No waiting events found dispatching network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:47:49 user nova-compute[73007]: WARNING nova.compute.manager [req-4be560be-ad3a-4fee-a6e0-6c4064a8bf24 req-d88a047b-209e-4f66-a0c9-4d2600e2161c service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received unexpected event network-vif-plugged-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 for instance with vm_state active and task_state deleting.
Aug 15 17:47:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-4be560be-ad3a-4fee-a6e0-6c4064a8bf24 req-d88a047b-209e-4f66-a0c9-4d2600e2161c service nova] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Received event network-vif-deleted-1f124901-40ef-497d-9479-7bb22833f3d4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-e814ad86-5c02-4d2c-bcbd-a0718adbf00c req-f7f33268-dc27-4fde-a981-2f554c5e61af service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-deleted-95359884-3e57-4e19-b56c-4ce0720f9d9b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:51 user nova-compute[73007]: INFO nova.compute.manager [req-e814ad86-5c02-4d2c-bcbd-a0718adbf00c req-f7f33268-dc27-4fde-a981-2f554c5e61af service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Neutron deleted interface 95359884-3e57-4e19-b56c-4ce0720f9d9b; detaching it from the instance and deleting it from the info cache
Aug 15 17:47:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-e814ad86-5c02-4d2c-bcbd-a0718adbf00c req-f7f33268-dc27-4fde-a981-2f554c5e61af service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "db8630a0-4d10-4051-9849-12f968c27580", "address": "fa:16:3e:26:a9:b0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb8630a0-4d", "ovs_interfaceid": "db8630a0-4d10-4051-9849-12f968c27580", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-e814ad86-5c02-4d2c-bcbd-a0718adbf00c req-f7f33268-dc27-4fde-a981-2f554c5e61af service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Detach interface failed, port_id=95359884-3e57-4e19-b56c-4ce0720f9d9b, reason: Instance e90005bb-24fc-4f17-9189-50b8ebd906ad could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:47:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-e814ad86-5c02-4d2c-bcbd-a0718adbf00c req-f7f33268-dc27-4fde-a981-2f554c5e61af service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-deleted-db8630a0-4d10-4051-9849-12f968c27580 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:51 user nova-compute[73007]: INFO nova.compute.manager [req-e814ad86-5c02-4d2c-bcbd-a0718adbf00c req-f7f33268-dc27-4fde-a981-2f554c5e61af service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Neutron deleted interface db8630a0-4d10-4051-9849-12f968c27580; detaching it from the instance and deleting it from the info cache
Aug 15 17:47:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-e814ad86-5c02-4d2c-bcbd-a0718adbf00c req-f7f33268-dc27-4fde-a981-2f554c5e61af service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "address": "fa:16:3e:93:f3:47", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2dc89bb-16", "ovs_interfaceid": "f2dc89bb-161d-4512-a9b4-56c6f1156d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-e814ad86-5c02-4d2c-bcbd-a0718adbf00c req-f7f33268-dc27-4fde-a981-2f554c5e61af service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Detach interface failed, port_id=db8630a0-4d10-4051-9849-12f968c27580, reason: Instance e90005bb-24fc-4f17-9189-50b8ebd906ad could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:47:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-5f6366be-06c5-45de-8a6e-1572b1edd140 req-8154258b-1509-4d25-a78c-61b2ec724fcf service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-deleted-f2dc89bb-161d-4512-a9b4-56c6f1156d93 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:53 user nova-compute[73007]: INFO nova.compute.manager [req-5f6366be-06c5-45de-8a6e-1572b1edd140 req-8154258b-1509-4d25-a78c-61b2ec724fcf service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Neutron deleted interface f2dc89bb-161d-4512-a9b4-56c6f1156d93; detaching it from the instance and deleting it from the info cache
Aug 15 17:47:53 user nova-compute[73007]: DEBUG nova.network.neutron [req-5f6366be-06c5-45de-8a6e-1572b1edd140 req-8154258b-1509-4d25-a78c-61b2ec724fcf service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "address": "fa:16:3e:eb:c0:35", "network": {"id": "e18c5c64-48c9-4e13-9ca4-9f49bccce562", "bridge": "br-int", "label": "tempest-device-tagging-net2-1968835746", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ec98d55-c3", "ovs_interfaceid": "7ec98d55-c39e-4aa1-9616-03f4d44bfb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-5f6366be-06c5-45de-8a6e-1572b1edd140 req-8154258b-1509-4d25-a78c-61b2ec724fcf service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Detach interface failed, port_id=f2dc89bb-161d-4512-a9b4-56c6f1156d93, reason: Instance e90005bb-24fc-4f17-9189-50b8ebd906ad could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:47:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-5f6366be-06c5-45de-8a6e-1572b1edd140 req-8154258b-1509-4d25-a78c-61b2ec724fcf service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-deleted-7ec98d55-c39e-4aa1-9616-03f4d44bfb09 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:53 user nova-compute[73007]: INFO nova.compute.manager [req-5f6366be-06c5-45de-8a6e-1572b1edd140 req-8154258b-1509-4d25-a78c-61b2ec724fcf service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Neutron deleted interface 7ec98d55-c39e-4aa1-9616-03f4d44bfb09; detaching it from the instance and deleting it from the info cache
Aug 15 17:47:53 user nova-compute[73007]: DEBUG nova.network.neutron [req-5f6366be-06c5-45de-8a6e-1572b1edd140 req-8154258b-1509-4d25-a78c-61b2ec724fcf service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [{"id": "512fb710-a869-4764-aabc-a5589e500850", "address": "fa:16:3e:13:64:16", "network": {"id": "2d52b81f-ab6c-47d0-86a0-62cb22357d57", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-160571846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap512fb710-a8", "ovs_interfaceid": "512fb710-a869-4764-aabc-a5589e500850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "address": "fa:16:3e:9b:3d:f0", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ed06db-22", "ovs_interfaceid": "c2ed06db-22e0-4601-a79a-fce4edb9d325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "address": "fa:16:3e:b7:fe:6a", "network": {"id": "33f0cdb0-cbc1-4238-859d-bdb2e7aa8612", "bridge": "br-int", "label": "tempest-device-tagging-net1-1357125468", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "677e7d9c21cd4f6fa9df0b9249060855", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9359e36-f5", "ovs_interfaceid": "e9359e36-f5a8-4f88-8375-2979cc99fa3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-5f6366be-06c5-45de-8a6e-1572b1edd140 req-8154258b-1509-4d25-a78c-61b2ec724fcf service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Detach interface failed, port_id=7ec98d55-c39e-4aa1-9616-03f4d44bfb09, reason: Instance e90005bb-24fc-4f17-9189-50b8ebd906ad could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:47:53 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:47:53 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Took 5.24 seconds to deallocate network for instance.
Aug 15 17:47:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-1bcdb4d8-cc15-4a9c-9bc7-cbebd0a60a95 req-924d94fe-5e60-4f33-b03a-cc1a013d887a service nova] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Received event network-vif-deleted-512fb710-a869-4764-aabc-a5589e500850 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:47:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:47:59 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121664.925237, 92002335-4c3a-4d9b-ba90-f1840c9142b5 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:47:59 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] VM Stopped (Lifecycle Event)
Aug 15 17:47:59 user nova-compute[73007]: DEBUG nova.compute.manager [None req-df4427e6-d8dc-414b-8ecd-6d083256b558 None None] [instance: 92002335-4c3a-4d9b-ba90-f1840c9142b5] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:48:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:01 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121666.7219517, e90005bb-24fc-4f17-9189-50b8ebd906ad => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:48:01 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] VM Stopped (Lifecycle Event)
Aug 15 17:48:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-cfacbbbe-d1e3-43ed-9a57-431f8823fdaa None None] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:48:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "64379e41-9e78-4389-aee2-14388d2366d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "64379e41-9e78-4389-aee2-14388d2366d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:48:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:48:01 user nova-compute[73007]: INFO nova.compute.claims [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Claim successful on node user
Aug 15 17:48:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.network.neutron [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:48:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.policy [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f02af903ce234948b57be7978398f8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b56c9a439844149abcefe8703cdc906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:48:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Creating image(s)
Aug 15 17:48:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "/opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "/opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "/opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.263s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk 1073741824" returned: 0 in 0.058s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Successfully created port: 350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.214s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Cannot resize image /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG nova.objects.instance [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lazy-loading 'migration_context' on Instance uuid 64379e41-9e78-4389-aee2-14388d2366d5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Ensure instance console log exists: /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Successfully updated port: 350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquired lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-5f201ac9-2268-48c4-b922-ba9482935bae req-0fb1d4d0-9e27-4bba-ac3a-022a53938887 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received event network-changed-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-5f201ac9-2268-48c4-b922-ba9482935bae req-0fb1d4d0-9e27-4bba-ac3a-022a53938887 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Refreshing instance network info cache due to event network-changed-350ee70d-90af-4550-a1d3-32b0b38a4e6d. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5f201ac9-2268-48c4-b922-ba9482935bae req-0fb1d4d0-9e27-4bba-ac3a-022a53938887 service nova] Acquiring lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Updating instance_info_cache with network_info: [{"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Releasing lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Instance network_info: |[{"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5f201ac9-2268-48c4-b922-ba9482935bae req-0fb1d4d0-9e27-4bba-ac3a-022a53938887 service nova] Acquired lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.neutron [req-5f201ac9-2268-48c4-b922-ba9482935bae req-0fb1d4d0-9e27-4bba-ac3a-022a53938887 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Refreshing network info cache for port 350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Start _get_guest_xml network_info=[{"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:48:04 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:48:04 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1138190980',display_name='tempest-ServersNegativeTestJSON-server-1138190980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1138190980',id=16,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b56c9a439844149abcefe8703cdc906',ramdisk_id='',reservation_id='r-cxmmgf55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1246805643',owner_user_name='tempest-ServersNegativeTestJSON-1246805643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:48:03Z,user_data=None,user_id='f02af903ce234948b57be7978398f8e8',uuid=64379e41-9e78-4389-aee2-14388d2366d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converting VIF {"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:77,bridge_name='br-int',has_traffic_filtering=True,id=350ee70d-90af-4550-a1d3-32b0b38a4e6d,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350ee70d-90') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.objects.instance [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lazy-loading 'pci_devices' on Instance uuid 64379e41-9e78-4389-aee2-14388d2366d5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:48:04 user nova-compute[73007]:   <uuid>64379e41-9e78-4389-aee2-14388d2366d5</uuid>
Aug 15 17:48:04 user nova-compute[73007]:   <name>instance-00000010</name>
Aug 15 17:48:04 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:48:04 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:48:04 user nova-compute[73007]:   <metadata>
Aug 15 17:48:04 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:48:04 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:48:04 user nova-compute[73007]:       <nova:name>tempest-ServersNegativeTestJSON-server-1138190980</nova:name>
Aug 15 17:48:04 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:48:04</nova:creationTime>
Aug 15 17:48:04 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:48:04 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:48:04 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:48:04 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:48:04 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:48:04 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:48:04 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:48:04 user nova-compute[73007]:       <nova:owner>
Aug 15 17:48:04 user nova-compute[73007]:         <nova:user uuid="f02af903ce234948b57be7978398f8e8">tempest-ServersNegativeTestJSON-1246805643-project-member</nova:user>
Aug 15 17:48:04 user nova-compute[73007]:         <nova:project uuid="0b56c9a439844149abcefe8703cdc906">tempest-ServersNegativeTestJSON-1246805643</nova:project>
Aug 15 17:48:04 user nova-compute[73007]:       </nova:owner>
Aug 15 17:48:04 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:48:04 user nova-compute[73007]:       <nova:ports>
Aug 15 17:48:04 user nova-compute[73007]:         <nova:port uuid="350ee70d-90af-4550-a1d3-32b0b38a4e6d">
Aug 15 17:48:04 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:48:04 user nova-compute[73007]:         </nova:port>
Aug 15 17:48:04 user nova-compute[73007]:       </nova:ports>
Aug 15 17:48:04 user nova-compute[73007]:     </nova:instance>
Aug 15 17:48:04 user nova-compute[73007]:   </metadata>
Aug 15 17:48:04 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:48:04 user nova-compute[73007]:     <system>
Aug 15 17:48:04 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:48:04 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:48:04 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:48:04 user nova-compute[73007]:       <entry name="serial">64379e41-9e78-4389-aee2-14388d2366d5</entry>
Aug 15 17:48:04 user nova-compute[73007]:       <entry name="uuid">64379e41-9e78-4389-aee2-14388d2366d5</entry>
Aug 15 17:48:04 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:48:04 user nova-compute[73007]:     </system>
Aug 15 17:48:04 user nova-compute[73007]:   </sysinfo>
Aug 15 17:48:04 user nova-compute[73007]:   <os>
Aug 15 17:48:04 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:48:04 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:48:04 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:48:04 user nova-compute[73007]:   </os>
Aug 15 17:48:04 user nova-compute[73007]:   <features>
Aug 15 17:48:04 user nova-compute[73007]:     <acpi/>
Aug 15 17:48:04 user nova-compute[73007]:     <apic/>
Aug 15 17:48:04 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:48:04 user nova-compute[73007]:   </features>
Aug 15 17:48:04 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:48:04 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:48:04 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:48:04 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:48:04 user nova-compute[73007]:   </clock>
Aug 15 17:48:04 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:48:04 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:48:04 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:48:04 user nova-compute[73007]:   </cpu>
Aug 15 17:48:04 user nova-compute[73007]:   <devices>
Aug 15 17:48:04 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:48:04 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:48:04 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk"/>
Aug 15 17:48:04 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:48:04 user nova-compute[73007]:     </disk>
Aug 15 17:48:04 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:48:04 user nova-compute[73007]:       <mac address="fa:16:3e:7b:3a:77"/>
Aug 15 17:48:04 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:48:04 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:48:04 user nova-compute[73007]:       <target dev="tap350ee70d-90"/>
Aug 15 17:48:04 user nova-compute[73007]:     </interface>
Aug 15 17:48:04 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:48:04 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/console.log" append="off"/>
Aug 15 17:48:04 user nova-compute[73007]:     </serial>
Aug 15 17:48:04 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:48:04 user nova-compute[73007]:     <video>
Aug 15 17:48:04 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:48:04 user nova-compute[73007]:     </video>
Aug 15 17:48:04 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:48:04 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:48:04 user nova-compute[73007]:     </rng>
Aug 15 17:48:04 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:48:04 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:48:04 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:48:04 user nova-compute[73007]:     </memballoon>
Aug 15 17:48:04 user nova-compute[73007]:   </devices>
Aug 15 17:48:04 user nova-compute[73007]: </domain>
Aug 15 17:48:04 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1138190980',display_name='tempest-ServersNegativeTestJSON-server-1138190980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1138190980',id=16,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b56c9a439844149abcefe8703cdc906',ramdisk_id='',reservation_id='r-cxmmgf55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1246805643',owner_user_name='tempest-ServersNegativeTestJSON-1246805643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:48:03Z,user_data=None,user_id='f02af903ce234948b57be7978398f8e8',uuid=64379e41-9e78-4389-aee2-14388d2366d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converting VIF {"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:77,bridge_name='br-int',has_traffic_filtering=True,id=350ee70d-90af-4550-a1d3-32b0b38a4e6d,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350ee70d-90') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG os_vif [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:77,bridge_name='br-int',has_traffic_filtering=True,id=350ee70d-90af-4550-a1d3-32b0b38a4e6d,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350ee70d-90') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap350ee70d-90, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap350ee70d-90, col_values=(('external_ids', {'iface-id': '350ee70d-90af-4550-a1d3-32b0b38a4e6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:3a:77', 'vm-uuid': '64379e41-9e78-4389-aee2-14388d2366d5'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:48:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:04 user nova-compute[73007]: INFO os_vif [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:77,bridge_name='br-int',has_traffic_filtering=True,id=350ee70d-90af-4550-a1d3-32b0b38a4e6d,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350ee70d-90')
Aug 15 17:48:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:48:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] No VIF found with MAC fa:16:3e:7b:3a:77, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:48:05 user nova-compute[73007]: DEBUG nova.network.neutron [req-5f201ac9-2268-48c4-b922-ba9482935bae req-0fb1d4d0-9e27-4bba-ac3a-022a53938887 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Updated VIF entry in instance network info cache for port 350ee70d-90af-4550-a1d3-32b0b38a4e6d. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:48:05 user nova-compute[73007]: DEBUG nova.network.neutron [req-5f201ac9-2268-48c4-b922-ba9482935bae req-0fb1d4d0-9e27-4bba-ac3a-022a53938887 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Updating instance_info_cache with network_info: [{"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:48:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5f201ac9-2268-48c4-b922-ba9482935bae req-0fb1d4d0-9e27-4bba-ac3a-022a53938887 service nova] Releasing lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-0232147c-778e-4b30-a29a-01fda56c8851 req-2fc81ca1-3457-4271-a101-7f887a4e9a00 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received event network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0232147c-778e-4b30-a29a-01fda56c8851 req-2fc81ca1-3457-4271-a101-7f887a4e9a00 service nova] Acquiring lock "64379e41-9e78-4389-aee2-14388d2366d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0232147c-778e-4b30-a29a-01fda56c8851 req-2fc81ca1-3457-4271-a101-7f887a4e9a00 service nova] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0232147c-778e-4b30-a29a-01fda56c8851 req-2fc81ca1-3457-4271-a101-7f887a4e9a00 service nova] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-0232147c-778e-4b30-a29a-01fda56c8851 req-2fc81ca1-3457-4271-a101-7f887a4e9a00 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] No waiting events found dispatching network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:48:06 user nova-compute[73007]: WARNING nova.compute.manager [req-0232147c-778e-4b30-a29a-01fda56c8851 req-2fc81ca1-3457-4271-a101-7f887a4e9a00 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received unexpected event network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d for instance with vm_state building and task_state spawning.
Aug 15 17:48:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-51027e9f-be5d-4dbd-b663-fac7018656e8 req-5b4e0ad2-e058-4b75-8f24-54c9aab2a384 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received event network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:48:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51027e9f-be5d-4dbd-b663-fac7018656e8 req-5b4e0ad2-e058-4b75-8f24-54c9aab2a384 service nova] Acquiring lock "64379e41-9e78-4389-aee2-14388d2366d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51027e9f-be5d-4dbd-b663-fac7018656e8 req-5b4e0ad2-e058-4b75-8f24-54c9aab2a384 service nova] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51027e9f-be5d-4dbd-b663-fac7018656e8 req-5b4e0ad2-e058-4b75-8f24-54c9aab2a384 service nova] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-51027e9f-be5d-4dbd-b663-fac7018656e8 req-5b4e0ad2-e058-4b75-8f24-54c9aab2a384 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] No waiting events found dispatching network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:48:08 user nova-compute[73007]: WARNING nova.compute.manager [req-51027e9f-be5d-4dbd-b663-fac7018656e8 req-5b4e0ad2-e058-4b75-8f24-54c9aab2a384 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received unexpected event network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d for instance with vm_state building and task_state spawning.
Aug 15 17:48:08 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121688.9602635, 64379e41-9e78-4389-aee2-14388d2366d5 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:48:08 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] VM Resumed (Lifecycle Event)
Aug 15 17:48:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:48:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:48:08 user nova-compute[73007]: INFO nova.compute.manager [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] [instance: e90005bb-24fc-4f17-9189-50b8ebd906ad] Took 15.19 seconds to detach 3 volumes for instance.
Aug 15 17:48:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Instance spawned successfully.
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:48:09 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121688.971259, 64379e41-9e78-4389-aee2-14388d2366d5 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:48:09 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] VM Started (Lifecycle Event)
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:09 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:48:09 user nova-compute[73007]: INFO nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Took 6.47 seconds to spawn the instance on the hypervisor.
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:48:09 user nova-compute[73007]: INFO nova.compute.manager [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Took 7.39 seconds to build instance.
Aug 15 17:48:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-61ce0ba0-8489-48f6-8d5f-9ee8bbfcaa90 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "64379e41-9e78-4389-aee2-14388d2366d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.514s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:09 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Deleted allocations for instance e90005bb-24fc-4f17-9189-50b8ebd906ad
Aug 15 17:48:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2c220319-1a04-44ce-b578-1735af5b54c4 tempest-TaggedBootDevicesTest-2121200936 tempest-TaggedBootDevicesTest-2121200936-project-member] Lock "e90005bb-24fc-4f17-9189-50b8ebd906ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 25.350s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:48:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:48:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:48:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:48:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:17 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:48:17 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7422MB free_disk=25.493419647216797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6b14b5d1-a493-4506-be76-029324a5aadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 31637822-05e9-4762-b3b3-2bc6e49efb6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 66b9060e-47dd-4ac6-9277-501ff800bffa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 2f4c50b0-1153-4b59-89d6-2192e5653827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance a82e6742-fe31-4693-8db5-50dc97f6072c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:48:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:48:18 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:48:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:48:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:48:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:19 user nova-compute[73007]: INFO nova.compute.manager [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Detaching volume b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b
Aug 15 17:48:19 user nova-compute[73007]: INFO nova.virt.block_device [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Attempting to driver detach volume b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b from mountpoint /dev/vdb
Aug 15 17:48:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Attempting to detach device vdb from instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:48:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:48:19 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:48:19 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 17:48:19 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:48:19 user nova-compute[73007]:   <serial>b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b</serial>
Aug 15 17:48:19 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:48:19 user nova-compute[73007]: </disk>
Aug 15 17:48:19 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:48:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully detached device vdb from instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 from the persistent domain config.
Aug 15 17:48:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:48:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:48:19 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:48:19 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 17:48:19 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:48:19 user nova-compute[73007]:   <serial>b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b</serial>
Aug 15 17:48:19 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:48:19 user nova-compute[73007]: </disk>
Aug 15 17:48:19 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:48:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121700.3062284, fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:48:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully detached device vdb from instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 from the live domain config.
Aug 15 17:48:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfCPdqSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:48:20 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d45951-a862-4642-a9bd-29664857d123]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbadb55-d630-40a6-b6dd-012586537b23]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:48:20 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:48:20 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:48:20 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:48:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:48:20 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:48:20 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:48:20 user nova-compute[73007]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b (non-flash)
Aug 15 17:48:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7e1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b'): ({'sdf'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Removing single pathed devices sdf {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85e7c66-6f96-4ec2-abb4-74db0edf3a45]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0666eeb1-e2e4-48d3-b865-40a4319df53b]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flushing IO for device /dev/sdf {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d7913c-ae93-4cf3-922e-e9b561f1994e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f643996e-404d-4543-963e-9a91fe6ba324]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e4b6b8-18cf-49b2-88ca-1b0487711402]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a0c65b-48fb-4fdb-8e2c-397eb4e29cf8]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b, portal: 172.16.0.220,3260]
Aug 15 17:48:20 user nova-compute[73007]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b, portal: 172.16.0.220,3260] successful.
Aug 15 17:48:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37a3d2d-9f30-4ac7-aad6-f840ebbb2a7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c1d318-063e-45eb-9362-3312bfefe77d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== disconnect_volume: return (308ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:48:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:48:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:48:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-700168cc-4ba9-427e-860d-2e1c247f7575 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.807s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:48:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:48:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:48:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:48:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:48:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "66b9060e-47dd-4ac6-9277-501ff800bffa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:44 user nova-compute[73007]: INFO nova.compute.manager [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Terminating instance
Aug 15 17:48:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Instance destroyed successfully.
Aug 15 17:48:44 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'resources' on Instance uuid 66b9060e-47dd-4ac6-9277-501ff800bffa {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1304891267',display_name='tempest-VolumesAdminNegativeTest-server-1304891267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1304891267',id=14,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:46:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40320dc41a5b47339fe34ded685fba41',ramdisk_id='',reservation_id='r-csm4zx3w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2030731104',owner_user_name='tempest-VolumesAdminNegativeTest-2030731104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:46:52Z,user_data=None,user_id='22977501a17f4458bb5c8be69a2c26b4',uuid=66b9060e-47dd-4ac6-9277-501ff800bffa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converting VIF {"id": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "address": "fa:16:3e:01:ea:48", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdef8484a-57", "ovs_interfaceid": "def8484a-57bb-4e6b-9ed8-04c587a958ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=def8484a-57bb-4e6b-9ed8-04c587a958ce,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef8484a-57') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG os_vif [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=def8484a-57bb-4e6b-9ed8-04c587a958ce,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef8484a-57') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdef8484a-57, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:44 user nova-compute[73007]: INFO os_vif [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ea:48,bridge_name='br-int',has_traffic_filtering=True,id=def8484a-57bb-4e6b-9ed8-04c587a958ce,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdef8484a-57')
Aug 15 17:48:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Deleting instance files /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa_del
Aug 15 17:48:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Deletion of /opt/stack/data/nova/instances/66b9060e-47dd-4ac6-9277-501ff800bffa_del complete
Aug 15 17:48:44 user nova-compute[73007]: INFO nova.compute.manager [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 17:48:44 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:48:44 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:48:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-64d0f320-d379-4049-86fd-e7fe482f4d43 req-58aded61-90aa-42bf-a0f1-632f4595593e service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received event network-vif-unplugged-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:48:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-64d0f320-d379-4049-86fd-e7fe482f4d43 req-58aded61-90aa-42bf-a0f1-632f4595593e service nova] Acquiring lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-64d0f320-d379-4049-86fd-e7fe482f4d43 req-58aded61-90aa-42bf-a0f1-632f4595593e service nova] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-64d0f320-d379-4049-86fd-e7fe482f4d43 req-58aded61-90aa-42bf-a0f1-632f4595593e service nova] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-64d0f320-d379-4049-86fd-e7fe482f4d43 req-58aded61-90aa-42bf-a0f1-632f4595593e service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] No waiting events found dispatching network-vif-unplugged-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:48:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-64d0f320-d379-4049-86fd-e7fe482f4d43 req-58aded61-90aa-42bf-a0f1-632f4595593e service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received event network-vif-unplugged-def8484a-57bb-4e6b-9ed8-04c587a958ce for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:48:46 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:48:46 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Took 1.16 seconds to deallocate network for instance.
Aug 15 17:48:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:46 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:48:46 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:48:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:46 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Deleted allocations for instance 66b9060e-47dd-4ac6-9277-501ff800bffa
Aug 15 17:48:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4f60dda5-5cd1-4134-9e52-914e65aca5d7 tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.588s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-492f599d-f835-44e7-afcb-2678710ccc14 req-e2fd648d-5086-4091-bb1e-638e1e94e450 service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received event network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:48:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-492f599d-f835-44e7-afcb-2678710ccc14 req-e2fd648d-5086-4091-bb1e-638e1e94e450 service nova] Acquiring lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-492f599d-f835-44e7-afcb-2678710ccc14 req-e2fd648d-5086-4091-bb1e-638e1e94e450 service nova] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-492f599d-f835-44e7-afcb-2678710ccc14 req-e2fd648d-5086-4091-bb1e-638e1e94e450 service nova] Lock "66b9060e-47dd-4ac6-9277-501ff800bffa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-492f599d-f835-44e7-afcb-2678710ccc14 req-e2fd648d-5086-4091-bb1e-638e1e94e450 service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] No waiting events found dispatching network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:48:47 user nova-compute[73007]: WARNING nova.compute.manager [req-492f599d-f835-44e7-afcb-2678710ccc14 req-e2fd648d-5086-4091-bb1e-638e1e94e450 service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received unexpected event network-vif-plugged-def8484a-57bb-4e6b-9ed8-04c587a958ce for instance with vm_state deleted and task_state None.
Aug 15 17:48:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-492f599d-f835-44e7-afcb-2678710ccc14 req-e2fd648d-5086-4091-bb1e-638e1e94e450 service nova] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Received event network-vif-deleted-def8484a-57bb-4e6b-9ed8-04c587a958ce {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:48:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:55 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 17:48:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:48:56 user nova-compute[73007]: INFO nova.compute.claims [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Claim successful on node user
Aug 15 17:48:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG nova.network.neutron [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:48:57 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:48:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG nova.policy [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c04d1f1310ec43aa9b4f500267105f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d1bc8ca5f444b73ae2ccf1c29c9dee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:48:57 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Creating image(s)
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.266s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk 1073741824" returned: 0 in 0.053s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:57 user nova-compute[73007]: DEBUG nova.network.neutron [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Successfully created port: 89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.258s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Cannot resize image /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG nova.objects.instance [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'migration_context' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Ensure instance console log exists: /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:48:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-6572ac86-fa8d-4801-9b6e-95663b73ffc1 req-d8caef73-50d8-46e4-93df-bb2a02c6414a service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-changed-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-6572ac86-fa8d-4801-9b6e-95663b73ffc1 req-d8caef73-50d8-46e4-93df-bb2a02c6414a service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Refreshing instance network info cache due to event network-changed-39025734-6212-4fa0-8dff-4a91a091bdfb. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6572ac86-fa8d-4801-9b6e-95663b73ffc1 req-d8caef73-50d8-46e4-93df-bb2a02c6414a service nova] Acquiring lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6572ac86-fa8d-4801-9b6e-95663b73ffc1 req-d8caef73-50d8-46e4-93df-bb2a02c6414a service nova] Acquired lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.network.neutron [req-6572ac86-fa8d-4801-9b6e-95663b73ffc1 req-d8caef73-50d8-46e4-93df-bb2a02c6414a service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Refreshing network info cache for port 39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Successfully updated port: 89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121724.8555665, 66b9060e-47dd-4ac6-9277-501ff800bffa => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:48:59 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] VM Stopped (Lifecycle Event)
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-f0d49ae7-2527-484a-91a9-bce34c8ff6b5 req-e7872319-3df8-4e48-91e3-7d67a37316a7 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-changed-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-f0d49ae7-2527-484a-91a9-bce34c8ff6b5 req-e7872319-3df8-4e48-91e3-7d67a37316a7 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Refreshing instance network info cache due to event network-changed-89f9df72-5653-4107-9de4-9919b16b7f17. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f0d49ae7-2527-484a-91a9-bce34c8ff6b5 req-e7872319-3df8-4e48-91e3-7d67a37316a7 service nova] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8f5ae4ed-ede0-4cfb-b70c-090905554ba4 None None] [instance: 66b9060e-47dd-4ac6-9277-501ff800bffa] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:48:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "interface-2f4c50b0-1153-4b59-89d6-2192e5653827-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "interface-2f4c50b0-1153-4b59-89d6-2192e5653827-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'flavor' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'pci_requests' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:49:00 user nova-compute[73007]: DEBUG nova.policy [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f75799308247a5a796ef4c8530b6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189c104825c64a5a86cb9f3e3c4d55a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updating instance_info_cache with network_info: [{"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-31637822-05e9-4762-b3b3-2bc6e49efb6e" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.neutron [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-6572ac86-fa8d-4801-9b6e-95663b73ffc1 req-d8caef73-50d8-46e4-93df-bb2a02c6414a service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updated VIF entry in instance network info cache for port 39025734-6212-4fa0-8dff-4a91a091bdfb. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-6572ac86-fa8d-4801-9b6e-95663b73ffc1 req-d8caef73-50d8-46e4-93df-bb2a02c6414a service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating instance_info_cache with network_info: [{"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance network_info: |[{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f0d49ae7-2527-484a-91a9-bce34c8ff6b5 req-e7872319-3df8-4e48-91e3-7d67a37316a7 service nova] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-f0d49ae7-2527-484a-91a9-bce34c8ff6b5 req-e7872319-3df8-4e48-91e3-7d67a37316a7 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Refreshing network info cache for port 89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Start _get_guest_xml network_info=[{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6572ac86-fa8d-4801-9b6e-95663b73ffc1 req-d8caef73-50d8-46e4-93df-bb2a02c6414a service nova] Releasing lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:01 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:01 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.objects.instance [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:49:01 user nova-compute[73007]:   <uuid>8b23c7bd-e243-4e1d-b88a-e394e3191344</uuid>
Aug 15 17:49:01 user nova-compute[73007]:   <name>instance-00000011</name>
Aug 15 17:49:01 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:49:01 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:49:01 user nova-compute[73007]:   <metadata>
Aug 15 17:49:01 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:01 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:49:01 user nova-compute[73007]:       <nova:name>tempest-ServerActionsTestOtherB-server-1486128635</nova:name>
Aug 15 17:49:01 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:49:01</nova:creationTime>
Aug 15 17:49:01 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:49:01 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:49:01 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:49:01 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:49:01 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:01 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:01 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:49:01 user nova-compute[73007]:       <nova:owner>
Aug 15 17:49:01 user nova-compute[73007]:         <nova:user uuid="c04d1f1310ec43aa9b4f500267105f1d">tempest-ServerActionsTestOtherB-604941371-project-member</nova:user>
Aug 15 17:49:01 user nova-compute[73007]:         <nova:project uuid="3d1bc8ca5f444b73ae2ccf1c29c9dee3">tempest-ServerActionsTestOtherB-604941371</nova:project>
Aug 15 17:49:01 user nova-compute[73007]:       </nova:owner>
Aug 15 17:49:01 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:01 user nova-compute[73007]:       <nova:ports>
Aug 15 17:49:01 user nova-compute[73007]:         <nova:port uuid="89f9df72-5653-4107-9de4-9919b16b7f17">
Aug 15 17:49:01 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 17:49:01 user nova-compute[73007]:         </nova:port>
Aug 15 17:49:01 user nova-compute[73007]:       </nova:ports>
Aug 15 17:49:01 user nova-compute[73007]:     </nova:instance>
Aug 15 17:49:01 user nova-compute[73007]:   </metadata>
Aug 15 17:49:01 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:49:01 user nova-compute[73007]:     <system>
Aug 15 17:49:01 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:49:01 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:49:01 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:49:01 user nova-compute[73007]:       <entry name="serial">8b23c7bd-e243-4e1d-b88a-e394e3191344</entry>
Aug 15 17:49:01 user nova-compute[73007]:       <entry name="uuid">8b23c7bd-e243-4e1d-b88a-e394e3191344</entry>
Aug 15 17:49:01 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:49:01 user nova-compute[73007]:     </system>
Aug 15 17:49:01 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:01 user nova-compute[73007]:   <os>
Aug 15 17:49:01 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:49:01 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:49:01 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:49:01 user nova-compute[73007]:   </os>
Aug 15 17:49:01 user nova-compute[73007]:   <features>
Aug 15 17:49:01 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:01 user nova-compute[73007]:     <apic/>
Aug 15 17:49:01 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:49:01 user nova-compute[73007]:   </features>
Aug 15 17:49:01 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:49:01 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:49:01 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:49:01 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:49:01 user nova-compute[73007]:   </clock>
Aug 15 17:49:01 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:49:01 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:49:01 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:49:01 user nova-compute[73007]:   </cpu>
Aug 15 17:49:01 user nova-compute[73007]:   <devices>
Aug 15 17:49:01 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:49:01 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:49:01 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk"/>
Aug 15 17:49:01 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:49:01 user nova-compute[73007]:     </disk>
Aug 15 17:49:01 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:49:01 user nova-compute[73007]:       <mac address="fa:16:3e:95:7c:d9"/>
Aug 15 17:49:01 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:01 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:49:01 user nova-compute[73007]:       <target dev="tap89f9df72-56"/>
Aug 15 17:49:01 user nova-compute[73007]:     </interface>
Aug 15 17:49:01 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:49:01 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/console.log" append="off"/>
Aug 15 17:49:01 user nova-compute[73007]:     </serial>
Aug 15 17:49:01 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:49:01 user nova-compute[73007]:     <video>
Aug 15 17:49:01 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:01 user nova-compute[73007]:     </video>
Aug 15 17:49:01 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:49:01 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:49:01 user nova-compute[73007]:     </rng>
Aug 15 17:49:01 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:49:01 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:49:01 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:49:01 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:01 user nova-compute[73007]:   </devices>
Aug 15 17:49:01 user nova-compute[73007]: </domain>
Aug 15 17:49:01 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG os_vif [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89f9df72-56, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89f9df72-56, col_values=(('external_ids', {'iface-id': '89f9df72-5653-4107-9de4-9919b16b7f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:7c:d9', 'vm-uuid': '8b23c7bd-e243-4e1d-b88a-e394e3191344'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:01 user nova-compute[73007]: INFO os_vif [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56')
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] No VIF found with MAC fa:16:3e:95:7c:d9, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-f0d49ae7-2527-484a-91a9-bce34c8ff6b5 req-e7872319-3df8-4e48-91e3-7d67a37316a7 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updated VIF entry in instance network info cache for port 89f9df72-5653-4107-9de4-9919b16b7f17. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-f0d49ae7-2527-484a-91a9-bce34c8ff6b5 req-e7872319-3df8-4e48-91e3-7d67a37316a7 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f0d49ae7-2527-484a-91a9-bce34c8ff6b5 req-e7872319-3df8-4e48-91e3-7d67a37316a7 service nova] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:01 user nova-compute[73007]: INFO nova.compute.manager [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Detaching volume d97f2255-077f-4b8e-88a5-d5ded468448b
Aug 15 17:49:01 user nova-compute[73007]: INFO nova.virt.block_device [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Attempting to driver detach volume d97f2255-077f-4b8e-88a5-d5ded468448b from mountpoint /dev/vdc
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Attempting to detach device vdc from instance a82e6742-fe31-4693-8db5-50dc97f6072c from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:49:01 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:01 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:49:01 user nova-compute[73007]:   <target dev="vdc" bus="virtio"/>
Aug 15 17:49:01 user nova-compute[73007]:   <serial>d97f2255-077f-4b8e-88a5-d5ded468448b</serial>
Aug 15 17:49:01 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 17:49:01 user nova-compute[73007]: </disk>
Aug 15 17:49:01 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:01 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully detached device vdc from instance a82e6742-fe31-4693-8db5-50dc97f6072c from the persistent domain config.
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a82e6742-fe31-4693-8db5-50dc97f6072c from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:49:01 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:01 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:49:01 user nova-compute[73007]:   <target dev="vdc" bus="virtio"/>
Aug 15 17:49:01 user nova-compute[73007]:   <serial>d97f2255-077f-4b8e-88a5-d5ded468448b</serial>
Aug 15 17:49:01 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 17:49:01 user nova-compute[73007]: </disk>
Aug 15 17:49:01 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:01 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Successfully created port: eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121742.4321783, a82e6742-fe31-4693-8db5-50dc97f6072c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:49:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully detached device vdc from instance a82e6742-fe31-4693-8db5-50dc97f6072c from the live domain config.
Aug 15 17:49:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PEbSsHDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:49:02 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[307a71f3-6f3f-45ab-9d17-1c03b5ace405]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[488e14e3-71e4-40e4-a0fd-e586830c97e7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:02 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:49:02 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:49:02 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:02 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:49:02 user nova-compute[73007]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b (non-flash)
Aug 15 17:49:02 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7be170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e52b630-e754-4685-9827-452d48d43777]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[808cf196-0287-44c0-940a-23587897f472]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0904908-6ef4-49ca-92c5-b5684928b0b8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:49:02 user nova-compute[73007]: INFO nova.compute.claims [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Claim successful on node user
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50a70a6-a0b7-4c29-bf53-64eb50162b93]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[322004d9-1e96-4247-86f8-500ab144e3e0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa94cb4a-c8e3-4120-8e8f-161b95f707f4]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b, portal: 172.16.0.220,3260]
Aug 15 17:49:02 user nova-compute[73007]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b, portal: 172.16.0.220,3260] successful.
Aug 15 17:49:02 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f2255-077f-4b8e-88a5-d5ded468448b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa57e928-f67e-4233-b48d-bff711ddfcd9]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] <== disconnect_volume: return (354ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:49:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.policy [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4d214b17e13412ab2fb1b797816aa7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b524d83f2464f89b96d677820abbd2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:49:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Creating image(s)
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "/opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "/opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "/opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Successfully updated port: eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquired lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.231s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG nova.objects.instance [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'flavor' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-db7c9adb-7f48-4c43-b9fd-4dfb0588b37a tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.082s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk 1073741824" returned: 0 in 0.108s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-782a82c4-909f-48d2-bc35-53ebacb32c9e req-3899df78-8552-4e50-aa74-7d8538d01701 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-changed-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-782a82c4-909f-48d2-bc35-53ebacb32c9e req-3899df78-8552-4e50-aa74-7d8538d01701 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Refreshing instance network info cache due to event network-changed-eb6f49e7-01a0-4204-afa2-66929240c722. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-782a82c4-909f-48d2-bc35-53ebacb32c9e req-3899df78-8552-4e50-aa74-7d8538d01701 service nova] Acquiring lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Successfully created port: 9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.243s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Cannot resize image /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.objects.instance [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'migration_context' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Ensure instance console log exists: /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Successfully updated port: 9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquired lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-02f671c2-8f13-4503-a34e-c46d4834b7ff req-bd8b1719-90a6-4ef2-a39c-f655c3d76c49 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received event network-changed-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-02f671c2-8f13-4503-a34e-c46d4834b7ff req-bd8b1719-90a6-4ef2-a39c-f655c3d76c49 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Refreshing instance network info cache due to event network-changed-9a0ba0fd-e69d-47c4-b71b-37286881a1a3. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:49:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-02f671c2-8f13-4503-a34e-c46d4834b7ff req-bd8b1719-90a6-4ef2-a39c-f655c3d76c49 service nova] Acquiring lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updating instance_info_cache with network_info: [{"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Releasing lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Instance network_info: |[{"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-02f671c2-8f13-4503-a34e-c46d4834b7ff req-bd8b1719-90a6-4ef2-a39c-f655c3d76c49 service nova] Acquired lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.neutron [req-02f671c2-8f13-4503-a34e-c46d4834b7ff req-bd8b1719-90a6-4ef2-a39c-f655c3d76c49 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Refreshing network info cache for port 9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Start _get_guest_xml network_info=[{"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating instance_info_cache with network_info: [{"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:05 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:05 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Releasing lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-782a82c4-909f-48d2-bc35-53ebacb32c9e req-3899df78-8552-4e50-aa74-7d8538d01701 service nova] Acquired lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.neutron [req-782a82c4-909f-48d2-bc35-53ebacb32c9e req-3899df78-8552-4e50-aa74-7d8538d01701 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Refreshing network info cache for port eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converting VIF {"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG os_vif [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-297317215',display_name='tempest-TestServerVolumeAttachmentScenario-server-297317215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-297317215',id=18,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6514sJKOud2eQpssNcoMHinH9oWzFLTGqvnSXcq3TS9OBwylzZPw2c0OICszq/ygPE/T++v0K/KriHfQCnh8Xcgbpbfy9SyBa2KvLn8dksnTa4h/j947fXQvuIDIz/kg==',key_name='tempest-keypair-1148712899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b524d83f2464f89b96d677820abbd2e',ramdisk_id='',reservation_id='r-9qtcq6nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-573443537',owner_user_name='tempest-TestServerVolumeAttachmentScenario-573443537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4d214b17e13412ab2fb1b797816aa7a',uuid=35fd679b-f098-4905-aa23-1fce430265bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Converting VIF {"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=9a0ba0fd-e69d-47c4-b71b-37286881a1a3,network=Network(47cb6677-09fa-4f83-82c9-a94ec4f2b7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0ba0fd-e6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.objects.instance [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'pci_devices' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb6f49e7-01, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb6f49e7-01, col_values=(('external_ids', {'iface-id': 'eb6f49e7-01a0-4204-afa2-66929240c722', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:34:7b', 'vm-uuid': '2f4c50b0-1153-4b59-89d6-2192e5653827'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:49:05 user nova-compute[73007]:   <uuid>35fd679b-f098-4905-aa23-1fce430265bd</uuid>
Aug 15 17:49:05 user nova-compute[73007]:   <name>instance-00000012</name>
Aug 15 17:49:05 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:49:05 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:49:05 user nova-compute[73007]:   <metadata>
Aug 15 17:49:05 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:05 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:49:05 user nova-compute[73007]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-297317215</nova:name>
Aug 15 17:49:05 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:49:05</nova:creationTime>
Aug 15 17:49:05 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:49:05 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:49:05 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:49:05 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:49:05 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:05 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:05 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:49:05 user nova-compute[73007]:       <nova:owner>
Aug 15 17:49:05 user nova-compute[73007]:         <nova:user uuid="b4d214b17e13412ab2fb1b797816aa7a">tempest-TestServerVolumeAttachmentScenario-573443537-project-member</nova:user>
Aug 15 17:49:05 user nova-compute[73007]:         <nova:project uuid="5b524d83f2464f89b96d677820abbd2e">tempest-TestServerVolumeAttachmentScenario-573443537</nova:project>
Aug 15 17:49:05 user nova-compute[73007]:       </nova:owner>
Aug 15 17:49:05 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:05 user nova-compute[73007]:       <nova:ports>
Aug 15 17:49:05 user nova-compute[73007]:         <nova:port uuid="9a0ba0fd-e69d-47c4-b71b-37286881a1a3">
Aug 15 17:49:05 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 17:49:05 user nova-compute[73007]:         </nova:port>
Aug 15 17:49:05 user nova-compute[73007]:       </nova:ports>
Aug 15 17:49:05 user nova-compute[73007]:     </nova:instance>
Aug 15 17:49:05 user nova-compute[73007]:   </metadata>
Aug 15 17:49:05 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:49:05 user nova-compute[73007]:     <system>
Aug 15 17:49:05 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:49:05 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:49:05 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:49:05 user nova-compute[73007]:       <entry name="serial">35fd679b-f098-4905-aa23-1fce430265bd</entry>
Aug 15 17:49:05 user nova-compute[73007]:       <entry name="uuid">35fd679b-f098-4905-aa23-1fce430265bd</entry>
Aug 15 17:49:05 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:49:05 user nova-compute[73007]:     </system>
Aug 15 17:49:05 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:05 user nova-compute[73007]:   <os>
Aug 15 17:49:05 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:49:05 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:49:05 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:49:05 user nova-compute[73007]:   </os>
Aug 15 17:49:05 user nova-compute[73007]:   <features>
Aug 15 17:49:05 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:05 user nova-compute[73007]:     <apic/>
Aug 15 17:49:05 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:49:05 user nova-compute[73007]:   </features>
Aug 15 17:49:05 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:49:05 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:49:05 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:49:05 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:49:05 user nova-compute[73007]:   </clock>
Aug 15 17:49:05 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:49:05 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:49:05 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:49:05 user nova-compute[73007]:   </cpu>
Aug 15 17:49:05 user nova-compute[73007]:   <devices>
Aug 15 17:49:05 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:49:05 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:49:05 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk"/>
Aug 15 17:49:05 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:49:05 user nova-compute[73007]:     </disk>
Aug 15 17:49:05 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:49:05 user nova-compute[73007]:       <mac address="fa:16:3e:8c:cb:95"/>
Aug 15 17:49:05 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:05 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:49:05 user nova-compute[73007]:       <target dev="tap9a0ba0fd-e6"/>
Aug 15 17:49:05 user nova-compute[73007]:     </interface>
Aug 15 17:49:05 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:49:05 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/console.log" append="off"/>
Aug 15 17:49:05 user nova-compute[73007]:     </serial>
Aug 15 17:49:05 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:49:05 user nova-compute[73007]:     <video>
Aug 15 17:49:05 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:05 user nova-compute[73007]:     </video>
Aug 15 17:49:05 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:49:05 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:49:05 user nova-compute[73007]:     </rng>
Aug 15 17:49:05 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:49:05 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:49:05 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:49:05 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:05 user nova-compute[73007]:   </devices>
Aug 15 17:49:05 user nova-compute[73007]: </domain>
Aug 15 17:49:05 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-297317215',display_name='tempest-TestServerVolumeAttachmentScenario-server-297317215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-297317215',id=18,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6514sJKOud2eQpssNcoMHinH9oWzFLTGqvnSXcq3TS9OBwylzZPw2c0OICszq/ygPE/T++v0K/KriHfQCnh8Xcgbpbfy9SyBa2KvLn8dksnTa4h/j947fXQvuIDIz/kg==',key_name='tempest-keypair-1148712899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b524d83f2464f89b96d677820abbd2e',ramdisk_id='',reservation_id='r-9qtcq6nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-573443537',owner_user_name='tempest-TestServerVolumeAttachmentScenario-573443537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4d214b17e13412ab2fb1b797816aa7a',uuid=35fd679b-f098-4905-aa23-1fce430265bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Converting VIF {"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=9a0ba0fd-e69d-47c4-b71b-37286881a1a3,network=Network(47cb6677-09fa-4f83-82c9-a94ec4f2b7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0ba0fd-e6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG os_vif [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=9a0ba0fd-e69d-47c4-b71b-37286881a1a3,network=Network(47cb6677-09fa-4f83-82c9-a94ec4f2b7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0ba0fd-e6') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: INFO os_vif [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01')
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converting VIF {"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a0ba0fd-e6, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a0ba0fd-e6, col_values=(('external_ids', {'iface-id': '9a0ba0fd-e69d-47c4-b71b-37286881a1a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:cb:95', 'vm-uuid': '35fd679b-f098-4905-aa23-1fce430265bd'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121745.665997, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:05 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Resumed (Lifecycle Event)
Aug 15 17:49:05 user nova-compute[73007]: INFO os_vif [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=9a0ba0fd-e69d-47c4-b71b-37286881a1a3,network=Network(47cb6677-09fa-4f83-82c9-a94ec4f2b7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0ba0fd-e6')
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] attach device xml: <interface type="ethernet">
Aug 15 17:49:05 user nova-compute[73007]:   <mac address="fa:16:3e:34:34:7b"/>
Aug 15 17:49:05 user nova-compute[73007]:   <model type="virtio"/>
Aug 15 17:49:05 user nova-compute[73007]:   <mtu size="1442"/>
Aug 15 17:49:05 user nova-compute[73007]:   <target dev="tapeb6f49e7-01"/>
Aug 15 17:49:05 user nova-compute[73007]: </interface>
Aug 15 17:49:05 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:05 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance spawned successfully.
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:49:05 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121745.6751144, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:05 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Started (Lifecycle Event)
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No VIF found with MAC fa:16:3e:8c:cb:95, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:05 user nova-compute[73007]: INFO nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Took 8.76 seconds to spawn the instance on the hypervisor.
Aug 15 17:49:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:05 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:49:06 user nova-compute[73007]: INFO nova.compute.manager [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Took 9.57 seconds to build instance.
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-621e1b59-abf9-4fcf-b7be-76b046ad24ca tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.697s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:06 user nova-compute[73007]: WARNING nova.compute.manager [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state active and task_state None.
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:06 user nova-compute[73007]: WARNING nova.compute.manager [req-8232605c-a6b8-47e0-9c3b-f7fa23534896 req-907a4895-968b-4e4a-a1c5-bebcb817901a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state active and task_state None.
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-02f671c2-8f13-4503-a34e-c46d4834b7ff req-bd8b1719-90a6-4ef2-a39c-f655c3d76c49 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updated VIF entry in instance network info cache for port 9a0ba0fd-e69d-47c4-b71b-37286881a1a3. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-02f671c2-8f13-4503-a34e-c46d4834b7ff req-bd8b1719-90a6-4ef2-a39c-f655c3d76c49 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updating instance_info_cache with network_info: [{"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-02f671c2-8f13-4503-a34e-c46d4834b7ff req-bd8b1719-90a6-4ef2-a39c-f655c3d76c49 service nova] Releasing lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No BDM found with device name hda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No VIF found with MAC fa:16:3e:cd:97:38, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:06 user nova-compute[73007]:   <nova:package version="0.0.0"/>
Aug 15 17:49:06 user nova-compute[73007]:   <nova:name>tempest-device-tagging-server-1208169056</nova:name>
Aug 15 17:49:06 user nova-compute[73007]:   <nova:creationTime>2023-08-15 17:49:06</nova:creationTime>
Aug 15 17:49:06 user nova-compute[73007]:   <nova:flavor name="m1.tiny">
Aug 15 17:49:06 user nova-compute[73007]:     <nova:memory>512</nova:memory>
Aug 15 17:49:06 user nova-compute[73007]:     <nova:disk>1</nova:disk>
Aug 15 17:49:06 user nova-compute[73007]:     <nova:swap>0</nova:swap>
Aug 15 17:49:06 user nova-compute[73007]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:06 user nova-compute[73007]:     <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:06 user nova-compute[73007]:   </nova:flavor>
Aug 15 17:49:06 user nova-compute[73007]:   <nova:owner>
Aug 15 17:49:06 user nova-compute[73007]:     <nova:user uuid="85f75799308247a5a796ef4c8530b6d8">tempest-TaggedAttachmentsTest-1156291487-project-member</nova:user>
Aug 15 17:49:06 user nova-compute[73007]:     <nova:project uuid="189c104825c64a5a86cb9f3e3c4d55a4">tempest-TaggedAttachmentsTest-1156291487</nova:project>
Aug 15 17:49:06 user nova-compute[73007]:   </nova:owner>
Aug 15 17:49:06 user nova-compute[73007]:   <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:06 user nova-compute[73007]:   <nova:ports>
Aug 15 17:49:06 user nova-compute[73007]:     <nova:port uuid="39025734-6212-4fa0-8dff-4a91a091bdfb">
Aug 15 17:49:06 user nova-compute[73007]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:49:06 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:06 user nova-compute[73007]:     <nova:port uuid="eb6f49e7-01a0-4204-afa2-66929240c722">
Aug 15 17:49:06 user nova-compute[73007]:       <nova:ip type="fixed" address="10.10.10.177" ipVersion="4"/>
Aug 15 17:49:06 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:06 user nova-compute[73007]:   </nova:ports>
Aug 15 17:49:06 user nova-compute[73007]: </nova:instance>
Aug 15 17:49:06 user nova-compute[73007]:  {{(pid=73007) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8eba98ad-9803-4106-98c4-f473fa433550 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "interface-2f4c50b0-1153-4b59-89d6-2192e5653827-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 6.042s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-782a82c4-909f-48d2-bc35-53ebacb32c9e req-3899df78-8552-4e50-aa74-7d8538d01701 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updated VIF entry in instance network info cache for port eb6f49e7-01a0-4204-afa2-66929240c722. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-782a82c4-909f-48d2-bc35-53ebacb32c9e req-3899df78-8552-4e50-aa74-7d8538d01701 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating instance_info_cache with network_info: [{"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.604s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-782a82c4-909f-48d2-bc35-53ebacb32c9e req-3899df78-8552-4e50-aa74-7d8538d01701 service nova] Releasing lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'flavor' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:07 user nova-compute[73007]: INFO nova.compute.manager [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Attaching volume 2c5cf433-b072-43d8-8694-c4c39f9d93c8 to /dev/vdb
Aug 15 17:49:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG os_brick.utils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa4b255-986c-4f3b-8217-6cec927da7c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9edfd9-2222-46de-bf6e-486a48282dc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.054s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6405bc96-935b-4c05-a586-dcc8a763c4cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3997b75-fd55-4b59-8b9b-d578b0651bb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:49:07 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7180c9-eb6c-482c-9d1e-a9739b20fae2]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG os_brick.utils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating existing volume attachment record: ba970034-8f60-4a5c-a39a-077729e97b1c {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] No waiting events found dispatching network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:08 user nova-compute[73007]: WARNING nova.compute.manager [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received unexpected event network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 for instance with vm_state active and task_state None.
Aug 15 17:49:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] No waiting events found dispatching network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:08 user nova-compute[73007]: WARNING nova.compute.manager [req-2667e5bd-d925-4a56-9e53-3861baa9cdc1 req-25625fb6-c215-4e97-b314-0784c5beee4c service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received unexpected event network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 for instance with vm_state active and task_state None.
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-b1a74f5e-7ac1-44d8-ae1a-61c9d820c29c req-1064fa1e-8c3b-4c98-ae66-e90e05092b57 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received event network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b1a74f5e-7ac1-44d8-ae1a-61c9d820c29c req-1064fa1e-8c3b-4c98-ae66-e90e05092b57 service nova] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b1a74f5e-7ac1-44d8-ae1a-61c9d820c29c req-1064fa1e-8c3b-4c98-ae66-e90e05092b57 service nova] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b1a74f5e-7ac1-44d8-ae1a-61c9d820c29c req-1064fa1e-8c3b-4c98-ae66-e90e05092b57 service nova] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-b1a74f5e-7ac1-44d8-ae1a-61c9d820c29c req-1064fa1e-8c3b-4c98-ae66-e90e05092b57 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] No waiting events found dispatching network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:08 user nova-compute[73007]: WARNING nova.compute.manager [req-b1a74f5e-7ac1-44d8-ae1a-61c9d820c29c req-1064fa1e-8c3b-4c98-ae66-e90e05092b57 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received unexpected event network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 for instance with vm_state building and task_state spawning.
Aug 15 17:49:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:09 user nova-compute[73007]: INFO nova.compute.manager [None req-259428f4-025a-4de7-a33c-936627def254 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Unrescuing
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-259428f4-025a-4de7-a33c-936627def254 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-259428f4-025a-4de7-a33c-936627def254 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquired lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-259428f4-025a-4de7-a33c-936627def254 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue --force-share --output=json" returned: 0 in 0.315s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:10 user nova-compute[73007]: INFO nova.compute.manager [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Terminating instance
Aug 15 17:49:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:49:10 user nova-compute[73007]: INFO nova.compute.claims [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Claim successful on node user
Aug 15 17:49:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG nova.compute.manager [req-b4467b04-c7ca-4a35-9f52-a222d9347dbb req-9d9af854-152f-4708-8db0-563f9a8d8ed1 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received event network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4467b04-c7ca-4a35-9f52-a222d9347dbb req-9d9af854-152f-4708-8db0-563f9a8d8ed1 service nova] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4467b04-c7ca-4a35-9f52-a222d9347dbb req-9d9af854-152f-4708-8db0-563f9a8d8ed1 service nova] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4467b04-c7ca-4a35-9f52-a222d9347dbb req-9d9af854-152f-4708-8db0-563f9a8d8ed1 service nova] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:10 user nova-compute[73007]: DEBUG nova.compute.manager [req-b4467b04-c7ca-4a35-9f52-a222d9347dbb req-9d9af854-152f-4708-8db0-563f9a8d8ed1 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] No waiting events found dispatching network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:10 user nova-compute[73007]: WARNING nova.compute.manager [req-b4467b04-c7ca-4a35-9f52-a222d9347dbb req-9d9af854-152f-4708-8db0-563f9a8d8ed1 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received unexpected event network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 for instance with vm_state building and task_state spawning.
Aug 15 17:49:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121750.7336671, 35fd679b-f098-4905-aa23-1fce430265bd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] VM Resumed (Lifecycle Event)
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Instance spawned successfully.
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Instance destroyed successfully.
Aug 15 17:49:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7484MB free_disk=25.47704315185547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'resources' on Instance uuid fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121750.734006, 35fd679b-f098-4905-aa23-1fce430265bd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] VM Started (Lifecycle Event)
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-f0e04cd1-0a04-444a-a6e3-22978a074ffa req-14be42e9-415f-4c73-9364-9328968a138f service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received event network-vif-unplugged-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f0e04cd1-0a04-444a-a6e3-22978a074ffa req-14be42e9-415f-4c73-9364-9328968a138f service nova] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f0e04cd1-0a04-444a-a6e3-22978a074ffa req-14be42e9-415f-4c73-9364-9328968a138f service nova] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f0e04cd1-0a04-444a-a6e3-22978a074ffa req-14be42e9-415f-4c73-9364-9328968a138f service nova] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-f0e04cd1-0a04-444a-a6e3-22978a074ffa req-14be42e9-415f-4c73-9364-9328968a138f service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] No waiting events found dispatching network-vif-unplugged-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-f0e04cd1-0a04-444a-a6e3-22978a074ffa req-14be42e9-415f-4c73-9364-9328968a138f service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received event network-vif-unplugged-4ca037da-7acd-4a45-a808-6a655ae3416b for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1294098274',display_name='tempest-AttachVolumeNegativeTest-server-1294098274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1294098274',id=3,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3Wmk5+4774bMab8WvB8/6GJhJd0I3p/XB5qhbR8dTT04lIBgObnm5Xq+favpCg3Gq+g0YxPWesNt1cgLYWkVbKXgYtE8p4n1COfLcmsXHzN6wTJQHLI7MBRYIHfaRW+w==',key_name='tempest-keypair-1417654794',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-htlezkf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=fd108aa2-dd29-41ed-9deb-41bc3d08c1e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "4ca037da-7acd-4a45-a808-6a655ae3416b", "address": "fa:16:3e:54:6d:12", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca037da-7a", "ovs_interfaceid": "4ca037da-7acd-4a45-a808-6a655ae3416b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:6d:12,bridge_name='br-int',has_traffic_filtering=True,id=4ca037da-7acd-4a45-a808-6a655ae3416b,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca037da-7a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG os_vif [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:6d:12,bridge_name='br-int',has_traffic_filtering=True,id=4ca037da-7acd-4a45-a808-6a655ae3416b,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca037da-7a') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ca037da-7a, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:11 user nova-compute[73007]: INFO os_vif [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:6d:12,bridge_name='br-int',has_traffic_filtering=True,id=4ca037da-7acd-4a45-a808-6a655ae3416b,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca037da-7a')
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Deleting instance files /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2_del
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Deletion of /opt/stack/data/nova/instances/fd108aa2-dd29-41ed-9deb-41bc3d08c1e2_del complete
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.compute.manager [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Took 1.63 seconds to destroy the instance on the hypervisor.
Aug 15 17:49:11 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:49:11 user nova-compute[73007]: INFO nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Took 8.53 seconds to spawn the instance on the hypervisor.
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-259428f4-025a-4de7-a33c-936627def254 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-259428f4-025a-4de7-a33c-936627def254 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Releasing lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-259428f4-025a-4de7-a33c-936627def254 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'flavor' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:12 user nova-compute[73007]: INFO nova.compute.manager [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Took 9.42 seconds to build instance.
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-50b83325-755b-40e3-87f0-8b54193b2fe8 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.533s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.195s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.696s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:49:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6b14b5d1-a493-4506-be76-029324a5aadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 31637822-05e9-4762-b3b3-2bc6e49efb6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 2f4c50b0-1153-4b59-89d6-2192e5653827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance a82e6742-fe31-4693-8db5-50dc97f6072c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 35fd679b-f098-4905-aa23-1fce430265bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 384f0339-eed5-4573-90fb-1dd91c4cce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-8ae92cf4-df02-4f9b-9b58-4df7dd1e7dcb req-b7e93020-ddad-49b7-b431-4b6f55527412 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ae92cf4-df02-4f9b-9b58-4df7dd1e7dcb req-b7e93020-ddad-49b7-b431-4b6f55527412 service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ae92cf4-df02-4f9b-9b58-4df7dd1e7dcb req-b7e93020-ddad-49b7-b431-4b6f55527412 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ae92cf4-df02-4f9b-9b58-4df7dd1e7dcb req-b7e93020-ddad-49b7-b431-4b6f55527412 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-8ae92cf4-df02-4f9b-9b58-4df7dd1e7dcb req-b7e93020-ddad-49b7-b431-4b6f55527412 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:12 user nova-compute[73007]: WARNING nova.compute.manager [req-8ae92cf4-df02-4f9b-9b58-4df7dd1e7dcb req-b7e93020-ddad-49b7-b431-4b6f55527412 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.policy [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b107f48a8a614494a0431c38e37f79f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dac3717304e944b3b364bc599eb8e0bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:49:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Creating image(s)
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "/opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "/opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "/opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance destroyed successfully.
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.367s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.917s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk 1073741824" returned: 0 in 0.068s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.226s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received event network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Acquiring lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] No waiting events found dispatching network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:13 user nova-compute[73007]: WARNING nova.compute.manager [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received unexpected event network-vif-plugged-4ca037da-7acd-4a45-a808-6a655ae3416b for instance with vm_state active and task_state deleting.
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-changed-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Refreshing instance network info cache due to event network-changed-74017a60-7a29-446b-9f9d-d26f80ddbba6. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Acquiring lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Acquired lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Refreshing network info cache for port 74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Cannot resize image /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.objects.instance [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'migration_context' on Instance uuid 384f0339-eed5-4573-90fb-1dd91c4cce90 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Ensure instance console log exists: /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:14 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Took 2.26 seconds to deallocate network for instance.
Aug 15 17:49:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-045d02e5-58e9-4155-93d7-4ff9c5a144b0 req-1a5ee480-b0a5-476e-8650-eb2698be0f23 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-045d02e5-58e9-4155-93d7-4ff9c5a144b0 req-1a5ee480-b0a5-476e-8650-eb2698be0f23 service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-045d02e5-58e9-4155-93d7-4ff9c5a144b0 req-1a5ee480-b0a5-476e-8650-eb2698be0f23 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-045d02e5-58e9-4155-93d7-4ff9c5a144b0 req-1a5ee480-b0a5-476e-8650-eb2698be0f23 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-045d02e5-58e9-4155-93d7-4ff9c5a144b0 req-1a5ee480-b0a5-476e-8650-eb2698be0f23 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:14 user nova-compute[73007]: WARNING nova.compute.manager [req-045d02e5-58e9-4155-93d7-4ff9c5a144b0 req-1a5ee480-b0a5-476e-8650-eb2698be0f23 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:49:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-045d02e5-58e9-4155-93d7-4ff9c5a144b0 req-1a5ee480-b0a5-476e-8650-eb2698be0f23 service nova] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Received event network-vif-deleted-4ca037da-7acd-4a45-a808-6a655ae3416b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:14 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Deleted allocations for instance fd108aa2-dd29-41ed-9deb-41bc3d08c1e2
Aug 15 17:49:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9a50d9e-a5ba-48db-9a8c-af4d183b975a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "fd108aa2-dd29-41ed-9deb-41bc3d08c1e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.660s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG nova.network.neutron [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Successfully created port: 54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updated VIF entry in instance network info cache for port 74017a60-7a29-446b-9f9d-d26f80ddbba6. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Releasing lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-changed-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Refreshing instance network info cache due to event network-changed-74017a60-7a29-446b-9f9d-d26f80ddbba6. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Acquiring lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Acquired lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Refreshing network info cache for port 74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:16 user nova-compute[73007]: INFO nova.compute.manager [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Detaching volume 71574eb8-e7fd-402a-8b17-9d8fee4997ff
Aug 15 17:49:16 user nova-compute[73007]: INFO nova.virt.block_device [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Attempting to driver detach volume 71574eb8-e7fd-402a-8b17-9d8fee4997ff from mountpoint /dev/vdb
Aug 15 17:49:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Attempting to detach device vdb from instance 42c38120-5e1d-4438-a53b-8a188e417c91 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:49:16 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:16 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:49:16 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:49:16 user nova-compute[73007]:   <serial>71574eb8-e7fd-402a-8b17-9d8fee4997ff</serial>
Aug 15 17:49:16 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 17:49:16 user nova-compute[73007]: </disk>
Aug 15 17:49:16 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully detached device vdb from instance 42c38120-5e1d-4438-a53b-8a188e417c91 from the persistent domain config.
Aug 15 17:49:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42c38120-5e1d-4438-a53b-8a188e417c91 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:49:16 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:16 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:49:16 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:49:16 user nova-compute[73007]:   <serial>71574eb8-e7fd-402a-8b17-9d8fee4997ff</serial>
Aug 15 17:49:16 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 17:49:16 user nova-compute[73007]: </disk>
Aug 15 17:49:16 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:16 user nova-compute[73007]: WARNING nova.compute.manager [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:49:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:16 user nova-compute[73007]: WARNING nova.compute.manager [req-b4fdf7f8-c0ce-4907-8d1a-0648c9e15b22 req-16902ad4-b583-42d0-b6e6-478ef128ee5d service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:49:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121757.2081213, 42c38120-5e1d-4438-a53b-8a188e417c91 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-259428f4-025a-4de7-a33c-936627def254 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:17 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully detached device vdb from instance 42c38120-5e1d-4438-a53b-8a188e417c91 from the live domain config.
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for 6b14b5d1-a493-4506-be76-029324a5aadd due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121757.2175722, 6b14b5d1-a493-4506-be76-029324a5aadd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:17 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] VM Resumed (Lifecycle Event)
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LPnHkcZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:49:17 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98276ec-d896-45dd-b384-b273324495c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3801647b-d768-4f88-9440-5bb29d4d2610]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:17 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:49:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:17 user nova-compute[73007]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff (non-flash)
Aug 15 17:49:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1150702200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30ee5f-ed36-4f0b-a989-ec07b962d8ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121757.2185314, 6b14b5d1-a493-4506-be76-029324a5aadd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:17 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] VM Started (Lifecycle Event)
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5afa13d-31e3-468f-908c-43bdb4bf0912]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[15acebc0-fa72-44fa-b4de-80577bc3f327]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7252f2e-f01d-4117-9640-b0e96f61386f]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f4de6-a7ad-414c-b887-412ed96f7d1b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc041aca-e722-4a45-b775-b9b72069e93e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260]
Aug 15 17:49:17 user nova-compute[73007]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff, portal: 172.16.0.220,3260] successful.
Aug 15 17:49:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71574eb8-e7fd-402a-8b17-9d8fee4997ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e54bdf-4443-4793-a6d4-9ee32939e413]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== disconnect_volume: return (407ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:49:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG nova.network.neutron [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updated VIF entry in instance network info cache for port 74017a60-7a29-446b-9f9d-d26f80ddbba6. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG nova.network.neutron [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [{"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-75c5eb3e-527f-4db5-99a8-870ef5a71883 req-91d03026-e6c1-429c-9ad6-0e5e3ce079a0 service nova] Releasing lock "refresh_cache-6b14b5d1-a493-4506-be76-029324a5aadd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Successfully updated port: 54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquired lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-e3ac9a8a-9723-449e-be28-0b81b9e71424 req-89e87263-317d-46f2-a70d-e3755c071c44 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received event network-changed-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-e3ac9a8a-9723-449e-be28-0b81b9e71424 req-89e87263-317d-46f2-a70d-e3755c071c44 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Refreshing instance network info cache due to event network-changed-54801e94-e676-4e15-9cb8-236b5c6dc420. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e3ac9a8a-9723-449e-be28-0b81b9e71424 req-89e87263-317d-46f2-a70d-e3755c071c44 service nova] Acquiring lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG nova.objects.instance [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41ec3b20-4a1f-4e04-96ce-5017c6f2bf1d tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.316s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Updating instance_info_cache with network_info: [{"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Releasing lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Instance network_info: |[{"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e3ac9a8a-9723-449e-be28-0b81b9e71424 req-89e87263-317d-46f2-a70d-e3755c071c44 service nova] Acquired lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-e3ac9a8a-9723-449e-be28-0b81b9e71424 req-89e87263-317d-46f2-a70d-e3755c071c44 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Refreshing network info cache for port 54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Start _get_guest_xml network_info=[{"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:49:19 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:19 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1234601535',display_name='tempest-VolumesSnapshotTestJSON-instance-1234601535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1234601535',id=19,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIgUbv7mld3AK9lMKUePfrGAOz86mtlmI1hS3su1oXd2wZe/unhzEf7s7+7R5Ep3BoKy6NW9thXaeCxzw+udgblO7slAFF8p6vZShbFeqGaHh/a28p5uLW2B3tEdqgI4A==',key_name='tempest-keypair-492944954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dac3717304e944b3b364bc599eb8e0bc',ramdisk_id='',reservation_id='r-8uibw994',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1500133320',owner_user_name='tempest-VolumesSnapshotTestJSON-1500133320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b107f48a8a614494a0431c38e37f79f6',uuid=384f0339-eed5-4573-90fb-1dd91c4cce90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converting VIF {"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=54801e94-e676-4e15-9cb8-236b5c6dc420,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54801e94-e6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.objects.instance [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'pci_devices' on Instance uuid 384f0339-eed5-4573-90fb-1dd91c4cce90 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:49:19 user nova-compute[73007]:   <uuid>384f0339-eed5-4573-90fb-1dd91c4cce90</uuid>
Aug 15 17:49:19 user nova-compute[73007]:   <name>instance-00000013</name>
Aug 15 17:49:19 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:49:19 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:49:19 user nova-compute[73007]:   <metadata>
Aug 15 17:49:19 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:19 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:49:19 user nova-compute[73007]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1234601535</nova:name>
Aug 15 17:49:19 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:49:19</nova:creationTime>
Aug 15 17:49:19 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:49:19 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:49:19 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:49:19 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:49:19 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:19 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:19 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:49:19 user nova-compute[73007]:       <nova:owner>
Aug 15 17:49:19 user nova-compute[73007]:         <nova:user uuid="b107f48a8a614494a0431c38e37f79f6">tempest-VolumesSnapshotTestJSON-1500133320-project-member</nova:user>
Aug 15 17:49:19 user nova-compute[73007]:         <nova:project uuid="dac3717304e944b3b364bc599eb8e0bc">tempest-VolumesSnapshotTestJSON-1500133320</nova:project>
Aug 15 17:49:19 user nova-compute[73007]:       </nova:owner>
Aug 15 17:49:19 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:19 user nova-compute[73007]:       <nova:ports>
Aug 15 17:49:19 user nova-compute[73007]:         <nova:port uuid="54801e94-e676-4e15-9cb8-236b5c6dc420">
Aug 15 17:49:19 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:49:19 user nova-compute[73007]:         </nova:port>
Aug 15 17:49:19 user nova-compute[73007]:       </nova:ports>
Aug 15 17:49:19 user nova-compute[73007]:     </nova:instance>
Aug 15 17:49:19 user nova-compute[73007]:   </metadata>
Aug 15 17:49:19 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:49:19 user nova-compute[73007]:     <system>
Aug 15 17:49:19 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:49:19 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:49:19 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:49:19 user nova-compute[73007]:       <entry name="serial">384f0339-eed5-4573-90fb-1dd91c4cce90</entry>
Aug 15 17:49:19 user nova-compute[73007]:       <entry name="uuid">384f0339-eed5-4573-90fb-1dd91c4cce90</entry>
Aug 15 17:49:19 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:49:19 user nova-compute[73007]:     </system>
Aug 15 17:49:19 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:19 user nova-compute[73007]:   <os>
Aug 15 17:49:19 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:49:19 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:49:19 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:49:19 user nova-compute[73007]:   </os>
Aug 15 17:49:19 user nova-compute[73007]:   <features>
Aug 15 17:49:19 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:19 user nova-compute[73007]:     <apic/>
Aug 15 17:49:19 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:49:19 user nova-compute[73007]:   </features>
Aug 15 17:49:19 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:49:19 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:49:19 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:49:19 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:49:19 user nova-compute[73007]:   </clock>
Aug 15 17:49:19 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:49:19 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:49:19 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:49:19 user nova-compute[73007]:   </cpu>
Aug 15 17:49:19 user nova-compute[73007]:   <devices>
Aug 15 17:49:19 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:49:19 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:49:19 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk"/>
Aug 15 17:49:19 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:49:19 user nova-compute[73007]:     </disk>
Aug 15 17:49:19 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:49:19 user nova-compute[73007]:       <mac address="fa:16:3e:a3:d2:ae"/>
Aug 15 17:49:19 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:19 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:49:19 user nova-compute[73007]:       <target dev="tap54801e94-e6"/>
Aug 15 17:49:19 user nova-compute[73007]:     </interface>
Aug 15 17:49:19 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:49:19 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/console.log" append="off"/>
Aug 15 17:49:19 user nova-compute[73007]:     </serial>
Aug 15 17:49:19 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:49:19 user nova-compute[73007]:     <video>
Aug 15 17:49:19 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:19 user nova-compute[73007]:     </video>
Aug 15 17:49:19 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:49:19 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:49:19 user nova-compute[73007]:     </rng>
Aug 15 17:49:19 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:49:19 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:49:19 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:49:19 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:19 user nova-compute[73007]:   </devices>
Aug 15 17:49:19 user nova-compute[73007]: </domain>
Aug 15 17:49:19 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1234601535',display_name='tempest-VolumesSnapshotTestJSON-instance-1234601535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1234601535',id=19,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIgUbv7mld3AK9lMKUePfrGAOz86mtlmI1hS3su1oXd2wZe/unhzEf7s7+7R5Ep3BoKy6NW9thXaeCxzw+udgblO7slAFF8p6vZShbFeqGaHh/a28p5uLW2B3tEdqgI4A==',key_name='tempest-keypair-492944954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dac3717304e944b3b364bc599eb8e0bc',ramdisk_id='',reservation_id='r-8uibw994',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1500133320',owner_user_name='tempest-VolumesSnapshotTestJSON-1500133320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b107f48a8a614494a0431c38e37f79f6',uuid=384f0339-eed5-4573-90fb-1dd91c4cce90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converting VIF {"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=54801e94-e676-4e15-9cb8-236b5c6dc420,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54801e94-e6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_vif [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=54801e94-e676-4e15-9cb8-236b5c6dc420,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54801e94-e6') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54801e94-e6, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54801e94-e6, col_values=(('external_ids', {'iface-id': '54801e94-e676-4e15-9cb8-236b5c6dc420', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:d2:ae', 'vm-uuid': '384f0339-eed5-4573-90fb-1dd91c4cce90'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:19 user nova-compute[73007]: INFO os_vif [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=54801e94-e676-4e15-9cb8-236b5c6dc420,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54801e94-e6')
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No VIF found with MAC fa:16:3e:a3:d2:ae, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-e3ac9a8a-9723-449e-be28-0b81b9e71424 req-89e87263-317d-46f2-a70d-e3755c071c44 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Updated VIF entry in instance network info cache for port 54801e94-e676-4e15-9cb8-236b5c6dc420. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-e3ac9a8a-9723-449e-be28-0b81b9e71424 req-89e87263-317d-46f2-a70d-e3755c071c44 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Updating instance_info_cache with network_info: [{"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKOJrMBe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:49:19 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:49:19 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:49:19 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e3ac9a8a-9723-449e-be28-0b81b9e71424 req-89e87263-317d-46f2-a70d-e3755c071c44 service nova] Releasing lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ff169-da2b-4a35-aa76-6967f78c9175]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:49:19 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6577825b-bd94-4f3b-9f5e-d59408b92def]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8] added
Aug 15 17:49:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7995a6-213d-4d27-acf7-213b07bf9c90]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e47f77c-299b-4fb3-95d8-0e4f16b7484f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yKOJrMBe {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yKOJrMBe" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0554588d-40c8-4db9-930b-05ee5a7cec00]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yKOJrMBe'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cb59d5-048e-436e-b951-7823160881aa]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bff811-b2d1-4182-9ac1-3055004cb38e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3420fea4-6b9a-4275-96dc-914532b9206b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3420fea4-6b9a-4275-96dc-914532b9206b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3420fea4-6b9a-4275-96dc-914532b9206b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3420fea4-6b9a-4275-96dc-914532b9206b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73007) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 17:49:19 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3420fea4-6b9a-4275-96dc-914532b9206b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86f5f7d-4dd7-4d59-8a0f-0bd9c7010444]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8, portal: 172.16.0.220,3260]
Aug 15 17:49:20 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8, portal: 172.16.0.220,3260] successful.
Aug 15 17:49:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65995a6-f4b4-4c40-8649-dd5ef60533fb]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0258f8fd-fd29-413d-99f5-664f21e76e4d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:20 user nova-compute[73007]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 (non-flash)
Aug 15 17:49:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:20 user nova-compute[73007]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 (non-flash)
Aug 15 17:49:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc4101-e1ff-42fc-bc08-e0da83c55177]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKOJrMBe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-56d14629-d809-497e-9575-e5b8ed6aeaee req-457ea469-922e-49ba-ba28-0b50282fedaf service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-56d14629-d809-497e-9575-e5b8ed6aeaee req-457ea469-922e-49ba-ba28-0b50282fedaf service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-56d14629-d809-497e-9575-e5b8ed6aeaee req-457ea469-922e-49ba-ba28-0b50282fedaf service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-56d14629-d809-497e-9575-e5b8ed6aeaee req-457ea469-922e-49ba-ba28-0b50282fedaf service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-56d14629-d809-497e-9575-e5b8ed6aeaee req-457ea469-922e-49ba-ba28-0b50282fedaf service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:20 user nova-compute[73007]: WARNING nova.compute.manager [req-56d14629-d809-497e-9575-e5b8ed6aeaee req-457ea469-922e-49ba-ba28-0b50282fedaf service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state active and task_state powering-off.
Aug 15 17:49:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23766376637386235', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766376637386235', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'flavor' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:49:21 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:21 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:49:21 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:49:21 user nova-compute[73007]:   <serial>2c5cf433-b072-43d8-8694-c4c39f9d93c8</serial>
Aug 15 17:49:21 user nova-compute[73007]: </disk>
Aug 15 17:49:21 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No BDM found with device name hda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] No VIF found with MAC fa:16:3e:cd:97:38, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-49db958c-6ba4-4414-9905-8780047f18a0 req-e7aacafd-0263-4675-aed1-9b136a5bac87 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received event network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-49db958c-6ba4-4414-9905-8780047f18a0 req-e7aacafd-0263-4675-aed1-9b136a5bac87 service nova] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-49db958c-6ba4-4414-9905-8780047f18a0 req-e7aacafd-0263-4675-aed1-9b136a5bac87 service nova] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-49db958c-6ba4-4414-9905-8780047f18a0 req-e7aacafd-0263-4675-aed1-9b136a5bac87 service nova] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-49db958c-6ba4-4414-9905-8780047f18a0 req-e7aacafd-0263-4675-aed1-9b136a5bac87 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] No waiting events found dispatching network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:22 user nova-compute[73007]: WARNING nova.compute.manager [req-49db958c-6ba4-4414-9905-8780047f18a0 req-e7aacafd-0263-4675-aed1-9b136a5bac87 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received unexpected event network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 for instance with vm_state building and task_state spawning.
Aug 15 17:49:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab1e889c-49e8-4185-943b-0d2049d977cc tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.743s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:22 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance destroyed successfully.
Aug 15 17:49:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3420fea4-6b9a-4275-96dc-914532b9206b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3420fea4-6b9a-4275-96dc-914532b9206b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.448s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-27c43372-accb-46e7-8986-38268861a479 req-27daf160-5e70-472a-9811-4c4b1108629a service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-27c43372-accb-46e7-8986-38268861a479 req-27daf160-5e70-472a-9811-4c4b1108629a service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-27c43372-accb-46e7-8986-38268861a479 req-27daf160-5e70-472a-9811-4c4b1108629a service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-27c43372-accb-46e7-8986-38268861a479 req-27daf160-5e70-472a-9811-4c4b1108629a service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-27c43372-accb-46e7-8986-38268861a479 req-27daf160-5e70-472a-9811-4c4b1108629a service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:22 user nova-compute[73007]: WARNING nova.compute.manager [req-27c43372-accb-46e7-8986-38268861a479 req-27daf160-5e70-472a-9811-4c4b1108629a service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state stopped and task_state None.
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.compute.manager [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Detaching volume 2c5cf433-b072-43d8-8694-c4c39f9d93c8
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-0a64d27b-05ee-4df9-8c85-dc7c6451f83f req-a8315f88-af49-4d7b-8e52-6198ca7f34bd service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received event network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0a64d27b-05ee-4df9-8c85-dc7c6451f83f req-a8315f88-af49-4d7b-8e52-6198ca7f34bd service nova] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0a64d27b-05ee-4df9-8c85-dc7c6451f83f req-a8315f88-af49-4d7b-8e52-6198ca7f34bd service nova] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0a64d27b-05ee-4df9-8c85-dc7c6451f83f req-a8315f88-af49-4d7b-8e52-6198ca7f34bd service nova] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-0a64d27b-05ee-4df9-8c85-dc7c6451f83f req-a8315f88-af49-4d7b-8e52-6198ca7f34bd service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] No waiting events found dispatching network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:24 user nova-compute[73007]: WARNING nova.compute.manager [req-0a64d27b-05ee-4df9-8c85-dc7c6451f83f req-a8315f88-af49-4d7b-8e52-6198ca7f34bd service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received unexpected event network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 for instance with vm_state building and task_state spawning.
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.virt.block_device [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Attempting to driver detach volume 2c5cf433-b072-43d8-8694-c4c39f9d93c8 from mountpoint /dev/vdb
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Attempting to detach device vdb from instance 2f4c50b0-1153-4b59-89d6-2192e5653827 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:49:24 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:24 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:49:24 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:49:24 user nova-compute[73007]:   <serial>2c5cf433-b072-43d8-8694-c4c39f9d93c8</serial>
Aug 15 17:49:24 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 17:49:24 user nova-compute[73007]: </disk>
Aug 15 17:49:24 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Successfully detached device vdb from instance 2f4c50b0-1153-4b59-89d6-2192e5653827 from the persistent domain config.
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f4c50b0-1153-4b59-89d6-2192e5653827 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:49:24 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:24 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:49:24 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:49:24 user nova-compute[73007]:   <serial>2c5cf433-b072-43d8-8694-c4c39f9d93c8</serial>
Aug 15 17:49:24 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 17:49:24 user nova-compute[73007]: </disk>
Aug 15 17:49:24 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121764.656476, 384f0339-eed5-4573-90fb-1dd91c4cce90 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] VM Resumed (Lifecycle Event)
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Instance spawned successfully.
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121764.6593723, 384f0339-eed5-4573-90fb-1dd91c4cce90 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] VM Started (Lifecycle Event)
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121764.7520983, 2f4c50b0-1153-4b59-89d6-2192e5653827 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Successfully detached device vdb from instance 2f4c50b0-1153-4b59-89d6-2192e5653827 from the live domain config.
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yKOJrMBe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:49:24 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:24 user nova-compute[73007]: INFO nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Took 12.15 seconds to spawn the instance on the hypervisor.
Aug 15 17:49:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae6e75f-a170-4454-9e2e-79f995510493]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[04465325-7935-42e5-a82c-30424606af03]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:24 user nova-compute[73007]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 (non-flash)
Aug 15 17:49:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:24 user nova-compute[73007]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 (non-flash)
Aug 15 17:49:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7bc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de35eed-5dd2-4ae4-b0ea-d1f0c4dc8bcd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa44aca-3c12-4431-bc55-bb5d0d2ab48e]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:49:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[407def9a-ca7b-4511-9de9-cf57cf0d216a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:25 user nova-compute[73007]: INFO nova.compute.manager [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Took 15.00 seconds to build instance.
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18ccc5f6-f19b-4c48-bff5-b1201c01964e tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.225s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e920ec8-50ce-4f4c-b4fc-b73491150e8c]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc359c-35ff-4a32-a437-e2d015af283a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aaa5be-a148-47f6-a9eb-a1cca163d4b7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8, portal: 172.16.0.220,3260]
Aug 15 17:49:25 user nova-compute[73007]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8, portal: 172.16.0.220,3260] successful.
Aug 15 17:49:25 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c5cf433-b072-43d8-8694-c4c39f9d93c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff90ba8-f0d7-45c2-a9eb-db652f6a4593]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] <== disconnect_volume: return (368ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:49:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'flavor' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-37da9065-7964-4725-a724-c2c5d7d98190 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.262s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "interface-2f4c50b0-1153-4b59-89d6-2192e5653827-eb6f49e7-01a0-4204-afa2-66929240c722" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "interface-2f4c50b0-1153-4b59-89d6-2192e5653827-eb6f49e7-01a0-4204-afa2-66929240c722" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'flavor' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converting VIF {"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface> {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface> {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Attempting to detach device tapeb6f49e7-01 from instance 2f4c50b0-1153-4b59-89d6-2192e5653827 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] detach device xml: <interface type="ethernet">
Aug 15 17:49:26 user nova-compute[73007]:   <mac address="fa:16:3e:34:34:7b"/>
Aug 15 17:49:26 user nova-compute[73007]:   <model type="virtio"/>
Aug 15 17:49:26 user nova-compute[73007]:   <mtu size="1442"/>
Aug 15 17:49:26 user nova-compute[73007]:   <target dev="tapeb6f49e7-01"/>
Aug 15 17:49:26 user nova-compute[73007]: </interface>
Aug 15 17:49:26 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface> {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface>not found in domain: <domain type='kvm' id='15'>
Aug 15 17:49:26 user nova-compute[73007]:   <name>instance-0000000f</name>
Aug 15 17:49:26 user nova-compute[73007]:   <uuid>2f4c50b0-1153-4b59-89d6-2192e5653827</uuid>
Aug 15 17:49:26 user nova-compute[73007]:   <metadata>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:26 user nova-compute[73007]:   <nova:package version="0.0.0"/>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:name>tempest-device-tagging-server-1208169056</nova:name>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:creationTime>2023-08-15 17:49:06</nova:creationTime>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:flavor name="m1.tiny">
Aug 15 17:49:26 user nova-compute[73007]:     <nova:memory>512</nova:memory>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:disk>1</nova:disk>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:swap>0</nova:swap>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:flavor>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:owner>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:user uuid="85f75799308247a5a796ef4c8530b6d8">tempest-TaggedAttachmentsTest-1156291487-project-member</nova:user>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:project uuid="189c104825c64a5a86cb9f3e3c4d55a4">tempest-TaggedAttachmentsTest-1156291487</nova:project>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:owner>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:ports>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:port uuid="39025734-6212-4fa0-8dff-4a91a091bdfb">
Aug 15 17:49:26 user nova-compute[73007]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:49:26 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:port uuid="eb6f49e7-01a0-4204-afa2-66929240c722">
Aug 15 17:49:26 user nova-compute[73007]:       <nova:ip type="fixed" address="10.10.10.177" ipVersion="4"/>
Aug 15 17:49:26 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:ports>
Aug 15 17:49:26 user nova-compute[73007]: </nova:instance>
Aug 15 17:49:26 user nova-compute[73007]:   </metadata>
Aug 15 17:49:26 user nova-compute[73007]:   <memory unit='KiB'>524288</memory>
Aug 15 17:49:26 user nova-compute[73007]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 17:49:26 user nova-compute[73007]:   <vcpu placement='static'>1</vcpu>
Aug 15 17:49:26 user nova-compute[73007]:   <resource>
Aug 15 17:49:26 user nova-compute[73007]:     <partition>/machine</partition>
Aug 15 17:49:26 user nova-compute[73007]:   </resource>
Aug 15 17:49:26 user nova-compute[73007]:   <sysinfo type='smbios'>
Aug 15 17:49:26 user nova-compute[73007]:     <system>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='version'>0.0.0</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='serial'>2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='uuid'>2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='family'>Virtual Machine</entry>
Aug 15 17:49:26 user nova-compute[73007]:     </system>
Aug 15 17:49:26 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:26 user nova-compute[73007]:   <os>
Aug 15 17:49:26 user nova-compute[73007]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 17:49:26 user nova-compute[73007]:     <boot dev='hd'/>
Aug 15 17:49:26 user nova-compute[73007]:     <smbios mode='sysinfo'/>
Aug 15 17:49:26 user nova-compute[73007]:   </os>
Aug 15 17:49:26 user nova-compute[73007]:   <features>
Aug 15 17:49:26 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:26 user nova-compute[73007]:     <apic/>
Aug 15 17:49:26 user nova-compute[73007]:     <vmcoreinfo state='on'/>
Aug 15 17:49:26 user nova-compute[73007]:   </features>
Aug 15 17:49:26 user nova-compute[73007]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 17:49:26 user nova-compute[73007]:     <model fallback='forbid'>Nehalem</model>
Aug 15 17:49:26 user nova-compute[73007]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 17:49:26 user nova-compute[73007]:     <feature policy='require' name='vme'/>
Aug 15 17:49:26 user nova-compute[73007]:     <feature policy='require' name='x2apic'/>
Aug 15 17:49:26 user nova-compute[73007]:     <feature policy='require' name='hypervisor'/>
Aug 15 17:49:26 user nova-compute[73007]:   </cpu>
Aug 15 17:49:26 user nova-compute[73007]:   <clock offset='utc'>
Aug 15 17:49:26 user nova-compute[73007]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 17:49:26 user nova-compute[73007]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 17:49:26 user nova-compute[73007]:     <timer name='hpet' present='no'/>
Aug 15 17:49:26 user nova-compute[73007]:   </clock>
Aug 15 17:49:26 user nova-compute[73007]:   <on_poweroff>destroy</on_poweroff>
Aug 15 17:49:26 user nova-compute[73007]:   <on_reboot>restart</on_reboot>
Aug 15 17:49:26 user nova-compute[73007]:   <on_crash>destroy</on_crash>
Aug 15 17:49:26 user nova-compute[73007]:   <devices>
Aug 15 17:49:26 user nova-compute[73007]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 17:49:26 user nova-compute[73007]:     <disk type='file' device='disk'>
Aug 15 17:49:26 user nova-compute[73007]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 17:49:26 user nova-compute[73007]:       <source file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk' index='2'/>
Aug 15 17:49:26 user nova-compute[73007]:       <backingStore type='file' index='3'>
Aug 15 17:49:26 user nova-compute[73007]:         <format type='raw'/>
Aug 15 17:49:26 user nova-compute[73007]:         <source file='/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5'/>
Aug 15 17:49:26 user nova-compute[73007]:         <backingStore/>
Aug 15 17:49:26 user nova-compute[73007]:       </backingStore>
Aug 15 17:49:26 user nova-compute[73007]:       <target dev='vda' bus='virtio'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='virtio-disk0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </disk>
Aug 15 17:49:26 user nova-compute[73007]:     <disk type='file' device='cdrom'>
Aug 15 17:49:26 user nova-compute[73007]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 17:49:26 user nova-compute[73007]:       <source file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.config' index='1'/>
Aug 15 17:49:26 user nova-compute[73007]:       <backingStore/>
Aug 15 17:49:26 user nova-compute[73007]:       <target dev='hda' bus='ide'/>
Aug 15 17:49:26 user nova-compute[73007]:       <readonly/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='ide0-0-0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </disk>
Aug 15 17:49:26 user nova-compute[73007]:     <controller type='usb' index='0' model='none'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='usb'/>
Aug 15 17:49:26 user nova-compute[73007]:     </controller>
Aug 15 17:49:26 user nova-compute[73007]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='pci.0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </controller>
Aug 15 17:49:26 user nova-compute[73007]:     <controller type='ide' index='0'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='ide'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 17:49:26 user nova-compute[73007]:     </controller>
Aug 15 17:49:26 user nova-compute[73007]:     <interface type='ethernet'>
Aug 15 17:49:26 user nova-compute[73007]:       <mac address='fa:16:3e:cd:97:38'/>
Aug 15 17:49:26 user nova-compute[73007]:       <target dev='tap39025734-62'/>
Aug 15 17:49:26 user nova-compute[73007]:       <model type='virtio'/>
Aug 15 17:49:26 user nova-compute[73007]:       <mtu size='1442'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='net0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </interface>
Aug 15 17:49:26 user nova-compute[73007]:     <interface type='ethernet'>
Aug 15 17:49:26 user nova-compute[73007]:       <mac address='fa:16:3e:34:34:7b'/>
Aug 15 17:49:26 user nova-compute[73007]:       <target dev='tapeb6f49e7-01'/>
Aug 15 17:49:26 user nova-compute[73007]:       <model type='virtio'/>
Aug 15 17:49:26 user nova-compute[73007]:       <mtu size='1442'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='net1'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </interface>
Aug 15 17:49:26 user nova-compute[73007]:     <serial type='pty'>
Aug 15 17:49:26 user nova-compute[73007]:       <source path='/dev/pts/6'/>
Aug 15 17:49:26 user nova-compute[73007]:       <log file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log' append='off'/>
Aug 15 17:49:26 user nova-compute[73007]:       <target type='isa-serial' port='0'>
Aug 15 17:49:26 user nova-compute[73007]:         <model name='isa-serial'/>
Aug 15 17:49:26 user nova-compute[73007]:       </target>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='serial0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </serial>
Aug 15 17:49:26 user nova-compute[73007]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 17:49:26 user nova-compute[73007]:       <source path='/dev/pts/6'/>
Aug 15 17:49:26 user nova-compute[73007]:       <log file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log' append='off'/>
Aug 15 17:49:26 user nova-compute[73007]:       <target type='serial' port='0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='serial0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </console>
Aug 15 17:49:26 user nova-compute[73007]:     <input type='mouse' bus='ps2'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='input0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </input>
Aug 15 17:49:26 user nova-compute[73007]:     <input type='keyboard' bus='ps2'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='input1'/>
Aug 15 17:49:26 user nova-compute[73007]:     </input>
Aug 15 17:49:26 user nova-compute[73007]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 15 17:49:26 user nova-compute[73007]:       <listen type='address' address='0.0.0.0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </graphics>
Aug 15 17:49:26 user nova-compute[73007]:     <audio id='1' type='none'/>
Aug 15 17:49:26 user nova-compute[73007]:     <video>
Aug 15 17:49:26 user nova-compute[73007]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='video0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </video>
Aug 15 17:49:26 user nova-compute[73007]:     <memballoon model='virtio'>
Aug 15 17:49:26 user nova-compute[73007]:       <stats period='10'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='balloon0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:26 user nova-compute[73007]:     <rng model='virtio'>
Aug 15 17:49:26 user nova-compute[73007]:       <backend model='random'>/dev/urandom</backend>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='rng0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </rng>
Aug 15 17:49:26 user nova-compute[73007]:   </devices>
Aug 15 17:49:26 user nova-compute[73007]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 17:49:26 user nova-compute[73007]:     <label>libvirt-2f4c50b0-1153-4b59-89d6-2192e5653827</label>
Aug 15 17:49:26 user nova-compute[73007]:     <imagelabel>libvirt-2f4c50b0-1153-4b59-89d6-2192e5653827</imagelabel>
Aug 15 17:49:26 user nova-compute[73007]:   </seclabel>
Aug 15 17:49:26 user nova-compute[73007]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 17:49:26 user nova-compute[73007]:     <label>+64055:+108</label>
Aug 15 17:49:26 user nova-compute[73007]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 17:49:26 user nova-compute[73007]:   </seclabel>
Aug 15 17:49:26 user nova-compute[73007]: </domain>
Aug 15 17:49:26 user nova-compute[73007]:  {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 17:49:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Successfully detached device tapeb6f49e7-01 from instance 2f4c50b0-1153-4b59-89d6-2192e5653827 from the persistent domain config.
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] (1/8): Attempting to detach device tapeb6f49e7-01 with device alias net1 from instance 2f4c50b0-1153-4b59-89d6-2192e5653827 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] detach device xml: <interface type="ethernet">
Aug 15 17:49:26 user nova-compute[73007]:   <mac address="fa:16:3e:34:34:7b"/>
Aug 15 17:49:26 user nova-compute[73007]:   <model type="virtio"/>
Aug 15 17:49:26 user nova-compute[73007]:   <mtu size="1442"/>
Aug 15 17:49:26 user nova-compute[73007]:   <target dev="tapeb6f49e7-01"/>
Aug 15 17:49:26 user nova-compute[73007]: </interface>
Aug 15 17:49:26 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121751.123575, fd108aa2-dd29-41ed-9deb-41bc3d08c1e2 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:26 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] VM Stopped (Lifecycle Event)
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121766.8657293, 2f4c50b0-1153-4b59-89d6-2192e5653827 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Start waiting for the detach event from libvirt for device tapeb6f49e7-01 with device alias net1 for instance 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface> {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-30b87c94-e062-4d2c-aabc-1902e4ad4722 None None] [instance: fd108aa2-dd29-41ed-9deb-41bc3d08c1e2] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface>not found in domain: <domain type='kvm' id='15'>
Aug 15 17:49:26 user nova-compute[73007]:   <name>instance-0000000f</name>
Aug 15 17:49:26 user nova-compute[73007]:   <uuid>2f4c50b0-1153-4b59-89d6-2192e5653827</uuid>
Aug 15 17:49:26 user nova-compute[73007]:   <metadata>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:26 user nova-compute[73007]:   <nova:package version="0.0.0"/>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:name>tempest-device-tagging-server-1208169056</nova:name>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:creationTime>2023-08-15 17:49:06</nova:creationTime>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:flavor name="m1.tiny">
Aug 15 17:49:26 user nova-compute[73007]:     <nova:memory>512</nova:memory>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:disk>1</nova:disk>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:swap>0</nova:swap>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:flavor>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:owner>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:user uuid="85f75799308247a5a796ef4c8530b6d8">tempest-TaggedAttachmentsTest-1156291487-project-member</nova:user>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:project uuid="189c104825c64a5a86cb9f3e3c4d55a4">tempest-TaggedAttachmentsTest-1156291487</nova:project>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:owner>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:ports>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:port uuid="39025734-6212-4fa0-8dff-4a91a091bdfb">
Aug 15 17:49:26 user nova-compute[73007]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:49:26 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:port uuid="eb6f49e7-01a0-4204-afa2-66929240c722">
Aug 15 17:49:26 user nova-compute[73007]:       <nova:ip type="fixed" address="10.10.10.177" ipVersion="4"/>
Aug 15 17:49:26 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:ports>
Aug 15 17:49:26 user nova-compute[73007]: </nova:instance>
Aug 15 17:49:26 user nova-compute[73007]:   </metadata>
Aug 15 17:49:26 user nova-compute[73007]:   <memory unit='KiB'>524288</memory>
Aug 15 17:49:26 user nova-compute[73007]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 17:49:26 user nova-compute[73007]:   <vcpu placement='static'>1</vcpu>
Aug 15 17:49:26 user nova-compute[73007]:   <resource>
Aug 15 17:49:26 user nova-compute[73007]:     <partition>/machine</partition>
Aug 15 17:49:26 user nova-compute[73007]:   </resource>
Aug 15 17:49:26 user nova-compute[73007]:   <sysinfo type='smbios'>
Aug 15 17:49:26 user nova-compute[73007]:     <system>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='version'>0.0.0</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='serial'>2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='uuid'>2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:49:26 user nova-compute[73007]:       <entry name='family'>Virtual Machine</entry>
Aug 15 17:49:26 user nova-compute[73007]:     </system>
Aug 15 17:49:26 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:26 user nova-compute[73007]:   <os>
Aug 15 17:49:26 user nova-compute[73007]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 17:49:26 user nova-compute[73007]:     <boot dev='hd'/>
Aug 15 17:49:26 user nova-compute[73007]:     <smbios mode='sysinfo'/>
Aug 15 17:49:26 user nova-compute[73007]:   </os>
Aug 15 17:49:26 user nova-compute[73007]:   <features>
Aug 15 17:49:26 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:26 user nova-compute[73007]:     <apic/>
Aug 15 17:49:26 user nova-compute[73007]:     <vmcoreinfo state='on'/>
Aug 15 17:49:26 user nova-compute[73007]:   </features>
Aug 15 17:49:26 user nova-compute[73007]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 17:49:26 user nova-compute[73007]:     <model fallback='forbid'>Nehalem</model>
Aug 15 17:49:26 user nova-compute[73007]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 17:49:26 user nova-compute[73007]:     <feature policy='require' name='vme'/>
Aug 15 17:49:26 user nova-compute[73007]:     <feature policy='require' name='x2apic'/>
Aug 15 17:49:26 user nova-compute[73007]:     <feature policy='require' name='hypervisor'/>
Aug 15 17:49:26 user nova-compute[73007]:   </cpu>
Aug 15 17:49:26 user nova-compute[73007]:   <clock offset='utc'>
Aug 15 17:49:26 user nova-compute[73007]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 17:49:26 user nova-compute[73007]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 17:49:26 user nova-compute[73007]:     <timer name='hpet' present='no'/>
Aug 15 17:49:26 user nova-compute[73007]:   </clock>
Aug 15 17:49:26 user nova-compute[73007]:   <on_poweroff>destroy</on_poweroff>
Aug 15 17:49:26 user nova-compute[73007]:   <on_reboot>restart</on_reboot>
Aug 15 17:49:26 user nova-compute[73007]:   <on_crash>destroy</on_crash>
Aug 15 17:49:26 user nova-compute[73007]:   <devices>
Aug 15 17:49:26 user nova-compute[73007]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 17:49:26 user nova-compute[73007]:     <disk type='file' device='disk'>
Aug 15 17:49:26 user nova-compute[73007]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 17:49:26 user nova-compute[73007]:       <source file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk' index='2'/>
Aug 15 17:49:26 user nova-compute[73007]:       <backingStore type='file' index='3'>
Aug 15 17:49:26 user nova-compute[73007]:         <format type='raw'/>
Aug 15 17:49:26 user nova-compute[73007]:         <source file='/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5'/>
Aug 15 17:49:26 user nova-compute[73007]:         <backingStore/>
Aug 15 17:49:26 user nova-compute[73007]:       </backingStore>
Aug 15 17:49:26 user nova-compute[73007]:       <target dev='vda' bus='virtio'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='virtio-disk0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </disk>
Aug 15 17:49:26 user nova-compute[73007]:     <disk type='file' device='cdrom'>
Aug 15 17:49:26 user nova-compute[73007]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 17:49:26 user nova-compute[73007]:       <source file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.config' index='1'/>
Aug 15 17:49:26 user nova-compute[73007]:       <backingStore/>
Aug 15 17:49:26 user nova-compute[73007]:       <target dev='hda' bus='ide'/>
Aug 15 17:49:26 user nova-compute[73007]:       <readonly/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='ide0-0-0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </disk>
Aug 15 17:49:26 user nova-compute[73007]:     <controller type='usb' index='0' model='none'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='usb'/>
Aug 15 17:49:26 user nova-compute[73007]:     </controller>
Aug 15 17:49:26 user nova-compute[73007]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='pci.0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </controller>
Aug 15 17:49:26 user nova-compute[73007]:     <controller type='ide' index='0'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='ide'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 17:49:26 user nova-compute[73007]:     </controller>
Aug 15 17:49:26 user nova-compute[73007]:     <interface type='ethernet'>
Aug 15 17:49:26 user nova-compute[73007]:       <mac address='fa:16:3e:cd:97:38'/>
Aug 15 17:49:26 user nova-compute[73007]:       <target dev='tap39025734-62'/>
Aug 15 17:49:26 user nova-compute[73007]:       <model type='virtio'/>
Aug 15 17:49:26 user nova-compute[73007]:       <mtu size='1442'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='net0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </interface>
Aug 15 17:49:26 user nova-compute[73007]:     <serial type='pty'>
Aug 15 17:49:26 user nova-compute[73007]:       <source path='/dev/pts/6'/>
Aug 15 17:49:26 user nova-compute[73007]:       <log file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log' append='off'/>
Aug 15 17:49:26 user nova-compute[73007]:       <target type='isa-serial' port='0'>
Aug 15 17:49:26 user nova-compute[73007]:         <model name='isa-serial'/>
Aug 15 17:49:26 user nova-compute[73007]:       </target>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='serial0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </serial>
Aug 15 17:49:26 user nova-compute[73007]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 17:49:26 user nova-compute[73007]:       <source path='/dev/pts/6'/>
Aug 15 17:49:26 user nova-compute[73007]:       <log file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log' append='off'/>
Aug 15 17:49:26 user nova-compute[73007]:       <target type='serial' port='0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='serial0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </console>
Aug 15 17:49:26 user nova-compute[73007]:     <input type='mouse' bus='ps2'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='input0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </input>
Aug 15 17:49:26 user nova-compute[73007]:     <input type='keyboard' bus='ps2'>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='input1'/>
Aug 15 17:49:26 user nova-compute[73007]:     </input>
Aug 15 17:49:26 user nova-compute[73007]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 15 17:49:26 user nova-compute[73007]:       <listen type='address' address='0.0.0.0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </graphics>
Aug 15 17:49:26 user nova-compute[73007]:     <audio id='1' type='none'/>
Aug 15 17:49:26 user nova-compute[73007]:     <video>
Aug 15 17:49:26 user nova-compute[73007]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='video0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </video>
Aug 15 17:49:26 user nova-compute[73007]:     <memballoon model='virtio'>
Aug 15 17:49:26 user nova-compute[73007]:       <stats period='10'/>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='balloon0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:26 user nova-compute[73007]:     <rng model='virtio'>
Aug 15 17:49:26 user nova-compute[73007]:       <backend model='random'>/dev/urandom</backend>
Aug 15 17:49:26 user nova-compute[73007]:       <alias name='rng0'/>
Aug 15 17:49:26 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 17:49:26 user nova-compute[73007]:     </rng>
Aug 15 17:49:26 user nova-compute[73007]:   </devices>
Aug 15 17:49:26 user nova-compute[73007]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 17:49:26 user nova-compute[73007]:     <label>libvirt-2f4c50b0-1153-4b59-89d6-2192e5653827</label>
Aug 15 17:49:26 user nova-compute[73007]:     <imagelabel>libvirt-2f4c50b0-1153-4b59-89d6-2192e5653827</imagelabel>
Aug 15 17:49:26 user nova-compute[73007]:   </seclabel>
Aug 15 17:49:26 user nova-compute[73007]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 17:49:26 user nova-compute[73007]:     <label>+64055:+108</label>
Aug 15 17:49:26 user nova-compute[73007]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 17:49:26 user nova-compute[73007]:   </seclabel>
Aug 15 17:49:26 user nova-compute[73007]: </domain>
Aug 15 17:49:26 user nova-compute[73007]:  {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 17:49:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Successfully detached device tapeb6f49e7-01 from instance 2f4c50b0-1153-4b59-89d6-2192e5653827 from the live domain config.
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converting VIF {"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG os_vif [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb6f49e7-01, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:26 user nova-compute[73007]: INFO os_vif [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01')
Aug 15 17:49:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:26 user nova-compute[73007]:   <nova:package version="0.0.0"/>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:name>tempest-device-tagging-server-1208169056</nova:name>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:creationTime>2023-08-15 17:49:26</nova:creationTime>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:flavor name="m1.tiny">
Aug 15 17:49:26 user nova-compute[73007]:     <nova:memory>512</nova:memory>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:disk>1</nova:disk>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:swap>0</nova:swap>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:flavor>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:owner>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:user uuid="85f75799308247a5a796ef4c8530b6d8">tempest-TaggedAttachmentsTest-1156291487-project-member</nova:user>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:project uuid="189c104825c64a5a86cb9f3e3c4d55a4">tempest-TaggedAttachmentsTest-1156291487</nova:project>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:owner>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:26 user nova-compute[73007]:   <nova:ports>
Aug 15 17:49:26 user nova-compute[73007]:     <nova:port uuid="39025734-6212-4fa0-8dff-4a91a091bdfb">
Aug 15 17:49:26 user nova-compute[73007]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:49:26 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:26 user nova-compute[73007]:   </nova:ports>
Aug 15 17:49:26 user nova-compute[73007]: </nova:instance>
Aug 15 17:49:26 user nova-compute[73007]:  {{(pid=73007) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4c16a43c-5e5a-4a94-9e47-99ad964f4b64 req-0f1c959f-753e-4147-a5c0-8c4ca6b9d39a service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-unplugged-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4c16a43c-5e5a-4a94-9e47-99ad964f4b64 req-0f1c959f-753e-4147-a5c0-8c4ca6b9d39a service nova] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4c16a43c-5e5a-4a94-9e47-99ad964f4b64 req-0f1c959f-753e-4147-a5c0-8c4ca6b9d39a service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4c16a43c-5e5a-4a94-9e47-99ad964f4b64 req-0f1c959f-753e-4147-a5c0-8c4ca6b9d39a service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-4c16a43c-5e5a-4a94-9e47-99ad964f4b64 req-0f1c959f-753e-4147-a5c0-8c4ca6b9d39a service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] No waiting events found dispatching network-vif-unplugged-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:27 user nova-compute[73007]: WARNING nova.compute.manager [req-4c16a43c-5e5a-4a94-9e47-99ad964f4b64 req-0f1c959f-753e-4147-a5c0-8c4ca6b9d39a service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received unexpected event network-vif-unplugged-eb6f49e7-01a0-4204-afa2-66929240c722 for instance with vm_state active and task_state None.
Aug 15 17:49:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-deleted-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:27 user nova-compute[73007]: INFO nova.compute.manager [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Neutron deleted interface eb6f49e7-01a0-4204-afa2-66929240c722; detaching it from the instance and deleting it from the info cache
Aug 15 17:49:27 user nova-compute[73007]: DEBUG nova.network.neutron [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating instance_info_cache with network_info: [{"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquired lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:27 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.objects.instance [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] Lazy-loading 'system_metadata' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.objects.instance [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] Lazy-loading 'flavor' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] Converting VIF {"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface> {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface>not found in domain: <domain type='kvm' id='15'>
Aug 15 17:49:28 user nova-compute[73007]:   <name>instance-0000000f</name>
Aug 15 17:49:28 user nova-compute[73007]:   <uuid>2f4c50b0-1153-4b59-89d6-2192e5653827</uuid>
Aug 15 17:49:28 user nova-compute[73007]:   <metadata>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:28 user nova-compute[73007]:   <nova:package version="0.0.0"/>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:name>tempest-device-tagging-server-1208169056</nova:name>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:creationTime>2023-08-15 17:49:26</nova:creationTime>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:flavor name="m1.tiny">
Aug 15 17:49:28 user nova-compute[73007]:     <nova:memory>512</nova:memory>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:disk>1</nova:disk>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:swap>0</nova:swap>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:flavor>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:owner>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:user uuid="85f75799308247a5a796ef4c8530b6d8">tempest-TaggedAttachmentsTest-1156291487-project-member</nova:user>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:project uuid="189c104825c64a5a86cb9f3e3c4d55a4">tempest-TaggedAttachmentsTest-1156291487</nova:project>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:owner>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:ports>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:port uuid="39025734-6212-4fa0-8dff-4a91a091bdfb">
Aug 15 17:49:28 user nova-compute[73007]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:49:28 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:ports>
Aug 15 17:49:28 user nova-compute[73007]: </nova:instance>
Aug 15 17:49:28 user nova-compute[73007]:   </metadata>
Aug 15 17:49:28 user nova-compute[73007]:   <memory unit='KiB'>524288</memory>
Aug 15 17:49:28 user nova-compute[73007]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 17:49:28 user nova-compute[73007]:   <vcpu placement='static'>1</vcpu>
Aug 15 17:49:28 user nova-compute[73007]:   <resource>
Aug 15 17:49:28 user nova-compute[73007]:     <partition>/machine</partition>
Aug 15 17:49:28 user nova-compute[73007]:   </resource>
Aug 15 17:49:28 user nova-compute[73007]:   <sysinfo type='smbios'>
Aug 15 17:49:28 user nova-compute[73007]:     <system>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='version'>0.0.0</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='serial'>2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='uuid'>2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='family'>Virtual Machine</entry>
Aug 15 17:49:28 user nova-compute[73007]:     </system>
Aug 15 17:49:28 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:28 user nova-compute[73007]:   <os>
Aug 15 17:49:28 user nova-compute[73007]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 17:49:28 user nova-compute[73007]:     <boot dev='hd'/>
Aug 15 17:49:28 user nova-compute[73007]:     <smbios mode='sysinfo'/>
Aug 15 17:49:28 user nova-compute[73007]:   </os>
Aug 15 17:49:28 user nova-compute[73007]:   <features>
Aug 15 17:49:28 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:28 user nova-compute[73007]:     <apic/>
Aug 15 17:49:28 user nova-compute[73007]:     <vmcoreinfo state='on'/>
Aug 15 17:49:28 user nova-compute[73007]:   </features>
Aug 15 17:49:28 user nova-compute[73007]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 17:49:28 user nova-compute[73007]:     <model fallback='forbid'>Nehalem</model>
Aug 15 17:49:28 user nova-compute[73007]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 17:49:28 user nova-compute[73007]:     <feature policy='require' name='vme'/>
Aug 15 17:49:28 user nova-compute[73007]:     <feature policy='require' name='x2apic'/>
Aug 15 17:49:28 user nova-compute[73007]:     <feature policy='require' name='hypervisor'/>
Aug 15 17:49:28 user nova-compute[73007]:   </cpu>
Aug 15 17:49:28 user nova-compute[73007]:   <clock offset='utc'>
Aug 15 17:49:28 user nova-compute[73007]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 17:49:28 user nova-compute[73007]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 17:49:28 user nova-compute[73007]:     <timer name='hpet' present='no'/>
Aug 15 17:49:28 user nova-compute[73007]:   </clock>
Aug 15 17:49:28 user nova-compute[73007]:   <on_poweroff>destroy</on_poweroff>
Aug 15 17:49:28 user nova-compute[73007]:   <on_reboot>restart</on_reboot>
Aug 15 17:49:28 user nova-compute[73007]:   <on_crash>destroy</on_crash>
Aug 15 17:49:28 user nova-compute[73007]:   <devices>
Aug 15 17:49:28 user nova-compute[73007]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 17:49:28 user nova-compute[73007]:     <disk type='file' device='disk'>
Aug 15 17:49:28 user nova-compute[73007]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 17:49:28 user nova-compute[73007]:       <source file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk' index='2'/>
Aug 15 17:49:28 user nova-compute[73007]:       <backingStore type='file' index='3'>
Aug 15 17:49:28 user nova-compute[73007]:         <format type='raw'/>
Aug 15 17:49:28 user nova-compute[73007]:         <source file='/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5'/>
Aug 15 17:49:28 user nova-compute[73007]:         <backingStore/>
Aug 15 17:49:28 user nova-compute[73007]:       </backingStore>
Aug 15 17:49:28 user nova-compute[73007]:       <target dev='vda' bus='virtio'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='virtio-disk0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </disk>
Aug 15 17:49:28 user nova-compute[73007]:     <disk type='file' device='cdrom'>
Aug 15 17:49:28 user nova-compute[73007]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 17:49:28 user nova-compute[73007]:       <source file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.config' index='1'/>
Aug 15 17:49:28 user nova-compute[73007]:       <backingStore/>
Aug 15 17:49:28 user nova-compute[73007]:       <target dev='hda' bus='ide'/>
Aug 15 17:49:28 user nova-compute[73007]:       <readonly/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='ide0-0-0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </disk>
Aug 15 17:49:28 user nova-compute[73007]:     <controller type='usb' index='0' model='none'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='usb'/>
Aug 15 17:49:28 user nova-compute[73007]:     </controller>
Aug 15 17:49:28 user nova-compute[73007]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='pci.0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </controller>
Aug 15 17:49:28 user nova-compute[73007]:     <controller type='ide' index='0'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='ide'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 17:49:28 user nova-compute[73007]:     </controller>
Aug 15 17:49:28 user nova-compute[73007]:     <interface type='ethernet'>
Aug 15 17:49:28 user nova-compute[73007]:       <mac address='fa:16:3e:cd:97:38'/>
Aug 15 17:49:28 user nova-compute[73007]:       <target dev='tap39025734-62'/>
Aug 15 17:49:28 user nova-compute[73007]:       <model type='virtio'/>
Aug 15 17:49:28 user nova-compute[73007]:       <mtu size='1442'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='net0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </interface>
Aug 15 17:49:28 user nova-compute[73007]:     <serial type='pty'>
Aug 15 17:49:28 user nova-compute[73007]:       <source path='/dev/pts/6'/>
Aug 15 17:49:28 user nova-compute[73007]:       <log file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log' append='off'/>
Aug 15 17:49:28 user nova-compute[73007]:       <target type='isa-serial' port='0'>
Aug 15 17:49:28 user nova-compute[73007]:         <model name='isa-serial'/>
Aug 15 17:49:28 user nova-compute[73007]:       </target>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='serial0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </serial>
Aug 15 17:49:28 user nova-compute[73007]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 17:49:28 user nova-compute[73007]:       <source path='/dev/pts/6'/>
Aug 15 17:49:28 user nova-compute[73007]:       <log file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log' append='off'/>
Aug 15 17:49:28 user nova-compute[73007]:       <target type='serial' port='0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='serial0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </console>
Aug 15 17:49:28 user nova-compute[73007]:     <input type='mouse' bus='ps2'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='input0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </input>
Aug 15 17:49:28 user nova-compute[73007]:     <input type='keyboard' bus='ps2'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='input1'/>
Aug 15 17:49:28 user nova-compute[73007]:     </input>
Aug 15 17:49:28 user nova-compute[73007]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 15 17:49:28 user nova-compute[73007]:       <listen type='address' address='0.0.0.0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </graphics>
Aug 15 17:49:28 user nova-compute[73007]:     <audio id='1' type='none'/>
Aug 15 17:49:28 user nova-compute[73007]:     <video>
Aug 15 17:49:28 user nova-compute[73007]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='video0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </video>
Aug 15 17:49:28 user nova-compute[73007]:     <memballoon model='virtio'>
Aug 15 17:49:28 user nova-compute[73007]:       <stats period='10'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='balloon0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:28 user nova-compute[73007]:     <rng model='virtio'>
Aug 15 17:49:28 user nova-compute[73007]:       <backend model='random'>/dev/urandom</backend>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='rng0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </rng>
Aug 15 17:49:28 user nova-compute[73007]:   </devices>
Aug 15 17:49:28 user nova-compute[73007]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 17:49:28 user nova-compute[73007]:     <label>libvirt-2f4c50b0-1153-4b59-89d6-2192e5653827</label>
Aug 15 17:49:28 user nova-compute[73007]:     <imagelabel>libvirt-2f4c50b0-1153-4b59-89d6-2192e5653827</imagelabel>
Aug 15 17:49:28 user nova-compute[73007]:   </seclabel>
Aug 15 17:49:28 user nova-compute[73007]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 17:49:28 user nova-compute[73007]:     <label>+64055:+108</label>
Aug 15 17:49:28 user nova-compute[73007]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 17:49:28 user nova-compute[73007]:   </seclabel>
Aug 15 17:49:28 user nova-compute[73007]: </domain>
Aug 15 17:49:28 user nova-compute[73007]:  {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface> {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:34:34:7b"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb6f49e7-01"/></interface>not found in domain: <domain type='kvm' id='15'>
Aug 15 17:49:28 user nova-compute[73007]:   <name>instance-0000000f</name>
Aug 15 17:49:28 user nova-compute[73007]:   <uuid>2f4c50b0-1153-4b59-89d6-2192e5653827</uuid>
Aug 15 17:49:28 user nova-compute[73007]:   <metadata>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:28 user nova-compute[73007]:   <nova:package version="0.0.0"/>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:name>tempest-device-tagging-server-1208169056</nova:name>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:creationTime>2023-08-15 17:49:26</nova:creationTime>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:flavor name="m1.tiny">
Aug 15 17:49:28 user nova-compute[73007]:     <nova:memory>512</nova:memory>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:disk>1</nova:disk>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:swap>0</nova:swap>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:flavor>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:owner>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:user uuid="85f75799308247a5a796ef4c8530b6d8">tempest-TaggedAttachmentsTest-1156291487-project-member</nova:user>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:project uuid="189c104825c64a5a86cb9f3e3c4d55a4">tempest-TaggedAttachmentsTest-1156291487</nova:project>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:owner>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:ports>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:port uuid="39025734-6212-4fa0-8dff-4a91a091bdfb">
Aug 15 17:49:28 user nova-compute[73007]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:49:28 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:ports>
Aug 15 17:49:28 user nova-compute[73007]: </nova:instance>
Aug 15 17:49:28 user nova-compute[73007]:   </metadata>
Aug 15 17:49:28 user nova-compute[73007]:   <memory unit='KiB'>524288</memory>
Aug 15 17:49:28 user nova-compute[73007]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 17:49:28 user nova-compute[73007]:   <vcpu placement='static'>1</vcpu>
Aug 15 17:49:28 user nova-compute[73007]:   <resource>
Aug 15 17:49:28 user nova-compute[73007]:     <partition>/machine</partition>
Aug 15 17:49:28 user nova-compute[73007]:   </resource>
Aug 15 17:49:28 user nova-compute[73007]:   <sysinfo type='smbios'>
Aug 15 17:49:28 user nova-compute[73007]:     <system>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='version'>0.0.0</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='serial'>2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='uuid'>2f4c50b0-1153-4b59-89d6-2192e5653827</entry>
Aug 15 17:49:28 user nova-compute[73007]:       <entry name='family'>Virtual Machine</entry>
Aug 15 17:49:28 user nova-compute[73007]:     </system>
Aug 15 17:49:28 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:28 user nova-compute[73007]:   <os>
Aug 15 17:49:28 user nova-compute[73007]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 17:49:28 user nova-compute[73007]:     <boot dev='hd'/>
Aug 15 17:49:28 user nova-compute[73007]:     <smbios mode='sysinfo'/>
Aug 15 17:49:28 user nova-compute[73007]:   </os>
Aug 15 17:49:28 user nova-compute[73007]:   <features>
Aug 15 17:49:28 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:28 user nova-compute[73007]:     <apic/>
Aug 15 17:49:28 user nova-compute[73007]:     <vmcoreinfo state='on'/>
Aug 15 17:49:28 user nova-compute[73007]:   </features>
Aug 15 17:49:28 user nova-compute[73007]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 17:49:28 user nova-compute[73007]:     <model fallback='forbid'>Nehalem</model>
Aug 15 17:49:28 user nova-compute[73007]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 17:49:28 user nova-compute[73007]:     <feature policy='require' name='vme'/>
Aug 15 17:49:28 user nova-compute[73007]:     <feature policy='require' name='x2apic'/>
Aug 15 17:49:28 user nova-compute[73007]:     <feature policy='require' name='hypervisor'/>
Aug 15 17:49:28 user nova-compute[73007]:   </cpu>
Aug 15 17:49:28 user nova-compute[73007]:   <clock offset='utc'>
Aug 15 17:49:28 user nova-compute[73007]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 17:49:28 user nova-compute[73007]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 17:49:28 user nova-compute[73007]:     <timer name='hpet' present='no'/>
Aug 15 17:49:28 user nova-compute[73007]:   </clock>
Aug 15 17:49:28 user nova-compute[73007]:   <on_poweroff>destroy</on_poweroff>
Aug 15 17:49:28 user nova-compute[73007]:   <on_reboot>restart</on_reboot>
Aug 15 17:49:28 user nova-compute[73007]:   <on_crash>destroy</on_crash>
Aug 15 17:49:28 user nova-compute[73007]:   <devices>
Aug 15 17:49:28 user nova-compute[73007]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 17:49:28 user nova-compute[73007]:     <disk type='file' device='disk'>
Aug 15 17:49:28 user nova-compute[73007]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 17:49:28 user nova-compute[73007]:       <source file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk' index='2'/>
Aug 15 17:49:28 user nova-compute[73007]:       <backingStore type='file' index='3'>
Aug 15 17:49:28 user nova-compute[73007]:         <format type='raw'/>
Aug 15 17:49:28 user nova-compute[73007]:         <source file='/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5'/>
Aug 15 17:49:28 user nova-compute[73007]:         <backingStore/>
Aug 15 17:49:28 user nova-compute[73007]:       </backingStore>
Aug 15 17:49:28 user nova-compute[73007]:       <target dev='vda' bus='virtio'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='virtio-disk0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </disk>
Aug 15 17:49:28 user nova-compute[73007]:     <disk type='file' device='cdrom'>
Aug 15 17:49:28 user nova-compute[73007]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 17:49:28 user nova-compute[73007]:       <source file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk.config' index='1'/>
Aug 15 17:49:28 user nova-compute[73007]:       <backingStore/>
Aug 15 17:49:28 user nova-compute[73007]:       <target dev='hda' bus='ide'/>
Aug 15 17:49:28 user nova-compute[73007]:       <readonly/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='ide0-0-0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </disk>
Aug 15 17:49:28 user nova-compute[73007]:     <controller type='usb' index='0' model='none'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='usb'/>
Aug 15 17:49:28 user nova-compute[73007]:     </controller>
Aug 15 17:49:28 user nova-compute[73007]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='pci.0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </controller>
Aug 15 17:49:28 user nova-compute[73007]:     <controller type='ide' index='0'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='ide'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 17:49:28 user nova-compute[73007]:     </controller>
Aug 15 17:49:28 user nova-compute[73007]:     <interface type='ethernet'>
Aug 15 17:49:28 user nova-compute[73007]:       <mac address='fa:16:3e:cd:97:38'/>
Aug 15 17:49:28 user nova-compute[73007]:       <target dev='tap39025734-62'/>
Aug 15 17:49:28 user nova-compute[73007]:       <model type='virtio'/>
Aug 15 17:49:28 user nova-compute[73007]:       <mtu size='1442'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='net0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </interface>
Aug 15 17:49:28 user nova-compute[73007]:     <serial type='pty'>
Aug 15 17:49:28 user nova-compute[73007]:       <source path='/dev/pts/6'/>
Aug 15 17:49:28 user nova-compute[73007]:       <log file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log' append='off'/>
Aug 15 17:49:28 user nova-compute[73007]:       <target type='isa-serial' port='0'>
Aug 15 17:49:28 user nova-compute[73007]:         <model name='isa-serial'/>
Aug 15 17:49:28 user nova-compute[73007]:       </target>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='serial0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </serial>
Aug 15 17:49:28 user nova-compute[73007]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 17:49:28 user nova-compute[73007]:       <source path='/dev/pts/6'/>
Aug 15 17:49:28 user nova-compute[73007]:       <log file='/opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/console.log' append='off'/>
Aug 15 17:49:28 user nova-compute[73007]:       <target type='serial' port='0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='serial0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </console>
Aug 15 17:49:28 user nova-compute[73007]:     <input type='mouse' bus='ps2'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='input0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </input>
Aug 15 17:49:28 user nova-compute[73007]:     <input type='keyboard' bus='ps2'>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='input1'/>
Aug 15 17:49:28 user nova-compute[73007]:     </input>
Aug 15 17:49:28 user nova-compute[73007]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 15 17:49:28 user nova-compute[73007]:       <listen type='address' address='0.0.0.0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </graphics>
Aug 15 17:49:28 user nova-compute[73007]:     <audio id='1' type='none'/>
Aug 15 17:49:28 user nova-compute[73007]:     <video>
Aug 15 17:49:28 user nova-compute[73007]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='video0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </video>
Aug 15 17:49:28 user nova-compute[73007]:     <memballoon model='virtio'>
Aug 15 17:49:28 user nova-compute[73007]:       <stats period='10'/>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='balloon0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:28 user nova-compute[73007]:     <rng model='virtio'>
Aug 15 17:49:28 user nova-compute[73007]:       <backend model='random'>/dev/urandom</backend>
Aug 15 17:49:28 user nova-compute[73007]:       <alias name='rng0'/>
Aug 15 17:49:28 user nova-compute[73007]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 17:49:28 user nova-compute[73007]:     </rng>
Aug 15 17:49:28 user nova-compute[73007]:   </devices>
Aug 15 17:49:28 user nova-compute[73007]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 17:49:28 user nova-compute[73007]:     <label>libvirt-2f4c50b0-1153-4b59-89d6-2192e5653827</label>
Aug 15 17:49:28 user nova-compute[73007]:     <imagelabel>libvirt-2f4c50b0-1153-4b59-89d6-2192e5653827</imagelabel>
Aug 15 17:49:28 user nova-compute[73007]:   </seclabel>
Aug 15 17:49:28 user nova-compute[73007]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 17:49:28 user nova-compute[73007]:     <label>+64055:+108</label>
Aug 15 17:49:28 user nova-compute[73007]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 17:49:28 user nova-compute[73007]:   </seclabel>
Aug 15 17:49:28 user nova-compute[73007]: </domain>
Aug 15 17:49:28 user nova-compute[73007]:  {{(pid=73007) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 17:49:28 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Detaching interface fa:16:3e:34:34:7b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapeb6f49e7-01' not found.
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] Converting VIF {"id": "eb6f49e7-01a0-4204-afa2-66929240c722", "address": "fa:16:3e:34:34:7b", "network": {"id": "62b60f70-0887-45b2-8efc-712719fc9d3c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2119284336", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.177", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6f49e7-01", "ovs_interfaceid": "eb6f49e7-01a0-4204-afa2-66929240c722", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG os_vif [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb6f49e7-01, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:49:28 user nova-compute[73007]: INFO os_vif [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:34:7b,bridge_name='br-int',has_traffic_filtering=True,id=eb6f49e7-01a0-4204-afa2-66929240c722,network=Network(62b60f70-0887-45b2-8efc-712719fc9d3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6f49e7-01')
Aug 15 17:49:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [req-32785a1f-9e42-47d4-89c9-53bd5e121f4c req-39a18d91-6b01-49b8-9a87-f19a44b17c13 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:28 user nova-compute[73007]:   <nova:package version="0.0.0"/>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:name>tempest-device-tagging-server-1208169056</nova:name>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:creationTime>2023-08-15 17:49:28</nova:creationTime>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:flavor name="m1.tiny">
Aug 15 17:49:28 user nova-compute[73007]:     <nova:memory>512</nova:memory>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:disk>1</nova:disk>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:swap>0</nova:swap>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:flavor>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:owner>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:user uuid="85f75799308247a5a796ef4c8530b6d8">tempest-TaggedAttachmentsTest-1156291487-project-member</nova:user>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:project uuid="189c104825c64a5a86cb9f3e3c4d55a4">tempest-TaggedAttachmentsTest-1156291487</nova:project>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:owner>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:28 user nova-compute[73007]:   <nova:ports>
Aug 15 17:49:28 user nova-compute[73007]:     <nova:port uuid="39025734-6212-4fa0-8dff-4a91a091bdfb">
Aug 15 17:49:28 user nova-compute[73007]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:49:28 user nova-compute[73007]:     </nova:port>
Aug 15 17:49:28 user nova-compute[73007]:   </nova:ports>
Aug 15 17:49:28 user nova-compute[73007]: </nova:instance>
Aug 15 17:49:28 user nova-compute[73007]:  {{(pid=73007) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 17:49:29 user nova-compute[73007]: INFO nova.network.neutron [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Port eb6f49e7-01a0-4204-afa2-66929240c722 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 15 17:49:29 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating instance_info_cache with network_info: [{"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Releasing lock "refresh_cache-2f4c50b0-1153-4b59-89d6-2192e5653827" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2781591b-1ccc-42e3-9839-0e87c93bdd0d tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "interface-2f4c50b0-1153-4b59-89d6-2192e5653827-eb6f49e7-01a0-4204-afa2-66929240c722" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.910s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-a3533712-f79d-4ae5-92a3-cd76074703ba req-7cb7c9a7-58f5-4b4a-8a49-23f096ab3a01 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a3533712-f79d-4ae5-92a3-cd76074703ba req-7cb7c9a7-58f5-4b4a-8a49-23f096ab3a01 service nova] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a3533712-f79d-4ae5-92a3-cd76074703ba req-7cb7c9a7-58f5-4b4a-8a49-23f096ab3a01 service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a3533712-f79d-4ae5-92a3-cd76074703ba req-7cb7c9a7-58f5-4b4a-8a49-23f096ab3a01 service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-a3533712-f79d-4ae5-92a3-cd76074703ba req-7cb7c9a7-58f5-4b4a-8a49-23f096ab3a01 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] No waiting events found dispatching network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:29 user nova-compute[73007]: WARNING nova.compute.manager [req-a3533712-f79d-4ae5-92a3-cd76074703ba req-7cb7c9a7-58f5-4b4a-8a49-23f096ab3a01 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received unexpected event network-vif-plugged-eb6f49e7-01a0-4204-afa2-66929240c722 for instance with vm_state active and task_state None.
Aug 15 17:49:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:49:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:49:33 user nova-compute[73007]: INFO nova.compute.claims [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Claim successful on node user
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:49:34 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:49:34 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Creating image(s)
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "/opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "/opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "/opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG nova.policy [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b7b5264253d44e9a51d06f66bed1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e88231a35bb4a2e8b5e1e7d5e5f9418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.251s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk 1073741824" returned: 0 in 0.047s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Successfully created port: 55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Cannot resize image /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'migration_context' on Instance uuid 582f3e3e-a05e-48dd-803d-b87a6eeda045 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Ensure instance console log exists: /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Successfully updated port: 55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-b49926db-0d1c-44fd-aece-d2f6ec2d76da req-5f274294-d37f-4fb0-b27f-b77d8ca79fcf service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received event network-changed-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-b49926db-0d1c-44fd-aece-d2f6ec2d76da req-5f274294-d37f-4fb0-b27f-b77d8ca79fcf service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Refreshing instance network info cache due to event network-changed-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b49926db-0d1c-44fd-aece-d2f6ec2d76da req-5f274294-d37f-4fb0-b27f-b77d8ca79fcf service nova] Acquiring lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b49926db-0d1c-44fd-aece-d2f6ec2d76da req-5f274294-d37f-4fb0-b27f-b77d8ca79fcf service nova] Acquired lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.neutron [req-b49926db-0d1c-44fd-aece-d2f6ec2d76da req-5f274294-d37f-4fb0-b27f-b77d8ca79fcf service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Refreshing network info cache for port 55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.neutron [req-b49926db-0d1c-44fd-aece-d2f6ec2d76da req-5f274294-d37f-4fb0-b27f-b77d8ca79fcf service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.neutron [req-b49926db-0d1c-44fd-aece-d2f6ec2d76da req-5f274294-d37f-4fb0-b27f-b77d8ca79fcf service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b49926db-0d1c-44fd-aece-d2f6ec2d76da req-5f274294-d37f-4fb0-b27f-b77d8ca79fcf service nova] Releasing lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquired lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updating instance_info_cache with network_info: [{"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Releasing lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Instance network_info: |[{"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Start _get_guest_xml network_info=[{"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:49:36 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:36 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1562029046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1562029046',id=20,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-mau3pqp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:34Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=582f3e3e-a05e-48dd-803d-b87a6eeda045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4c:42,bridge_name='br-int',has_traffic_filtering=True,id=55ac3f2c-af4d-4c2b-aae3-e5106fec4e21,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ac3f2c-af') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'pci_devices' on Instance uuid 582f3e3e-a05e-48dd-803d-b87a6eeda045 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:49:37 user nova-compute[73007]:   <uuid>582f3e3e-a05e-48dd-803d-b87a6eeda045</uuid>
Aug 15 17:49:37 user nova-compute[73007]:   <name>instance-00000014</name>
Aug 15 17:49:37 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:49:37 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:49:37 user nova-compute[73007]:   <metadata>
Aug 15 17:49:37 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:37 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:49:37 user nova-compute[73007]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1562029046</nova:name>
Aug 15 17:49:37 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:49:36</nova:creationTime>
Aug 15 17:49:37 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:49:37 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:49:37 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:49:37 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:49:37 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:37 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:37 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:49:37 user nova-compute[73007]:       <nova:owner>
Aug 15 17:49:37 user nova-compute[73007]:         <nova:user uuid="2b7b5264253d44e9a51d06f66bed1443">tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member</nova:user>
Aug 15 17:49:37 user nova-compute[73007]:         <nova:project uuid="6e88231a35bb4a2e8b5e1e7d5e5f9418">tempest-ServerBootFromVolumeStableRescueTest-452961283</nova:project>
Aug 15 17:49:37 user nova-compute[73007]:       </nova:owner>
Aug 15 17:49:37 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:37 user nova-compute[73007]:       <nova:ports>
Aug 15 17:49:37 user nova-compute[73007]:         <nova:port uuid="55ac3f2c-af4d-4c2b-aae3-e5106fec4e21">
Aug 15 17:49:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:49:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:49:37 user nova-compute[73007]:       </nova:ports>
Aug 15 17:49:37 user nova-compute[73007]:     </nova:instance>
Aug 15 17:49:37 user nova-compute[73007]:   </metadata>
Aug 15 17:49:37 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:49:37 user nova-compute[73007]:     <system>
Aug 15 17:49:37 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:49:37 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:49:37 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:49:37 user nova-compute[73007]:       <entry name="serial">582f3e3e-a05e-48dd-803d-b87a6eeda045</entry>
Aug 15 17:49:37 user nova-compute[73007]:       <entry name="uuid">582f3e3e-a05e-48dd-803d-b87a6eeda045</entry>
Aug 15 17:49:37 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:49:37 user nova-compute[73007]:     </system>
Aug 15 17:49:37 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:37 user nova-compute[73007]:   <os>
Aug 15 17:49:37 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:49:37 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:49:37 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:49:37 user nova-compute[73007]:   </os>
Aug 15 17:49:37 user nova-compute[73007]:   <features>
Aug 15 17:49:37 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:37 user nova-compute[73007]:     <apic/>
Aug 15 17:49:37 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:49:37 user nova-compute[73007]:   </features>
Aug 15 17:49:37 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:49:37 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:49:37 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:49:37 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:49:37 user nova-compute[73007]:   </clock>
Aug 15 17:49:37 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:49:37 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:49:37 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:49:37 user nova-compute[73007]:   </cpu>
Aug 15 17:49:37 user nova-compute[73007]:   <devices>
Aug 15 17:49:37 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:49:37 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:49:37 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk"/>
Aug 15 17:49:37 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:49:37 user nova-compute[73007]:     </disk>
Aug 15 17:49:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:49:37 user nova-compute[73007]:       <mac address="fa:16:3e:09:4c:42"/>
Aug 15 17:49:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:49:37 user nova-compute[73007]:       <target dev="tap55ac3f2c-af"/>
Aug 15 17:49:37 user nova-compute[73007]:     </interface>
Aug 15 17:49:37 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:49:37 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/console.log" append="off"/>
Aug 15 17:49:37 user nova-compute[73007]:     </serial>
Aug 15 17:49:37 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:49:37 user nova-compute[73007]:     <video>
Aug 15 17:49:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:37 user nova-compute[73007]:     </video>
Aug 15 17:49:37 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:49:37 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:49:37 user nova-compute[73007]:     </rng>
Aug 15 17:49:37 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:49:37 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:49:37 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:49:37 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:37 user nova-compute[73007]:   </devices>
Aug 15 17:49:37 user nova-compute[73007]: </domain>
Aug 15 17:49:37 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1562029046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1562029046',id=20,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-mau3pqp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:34Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=582f3e3e-a05e-48dd-803d-b87a6eeda045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4c:42,bridge_name='br-int',has_traffic_filtering=True,id=55ac3f2c-af4d-4c2b-aae3-e5106fec4e21,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ac3f2c-af') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG os_vif [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4c:42,bridge_name='br-int',has_traffic_filtering=True,id=55ac3f2c-af4d-4c2b-aae3-e5106fec4e21,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ac3f2c-af') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55ac3f2c-af, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55ac3f2c-af, col_values=(('external_ids', {'iface-id': '55ac3f2c-af4d-4c2b-aae3-e5106fec4e21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:4c:42', 'vm-uuid': '582f3e3e-a05e-48dd-803d-b87a6eeda045'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:37 user nova-compute[73007]: INFO os_vif [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4c:42,bridge_name='br-int',has_traffic_filtering=True,id=55ac3f2c-af4d-4c2b-aae3-e5106fec4e21,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ac3f2c-af')
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No VIF found with MAC fa:16:3e:09:4c:42, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121762.2931356, 42c38120-5e1d-4438-a53b-8a188e417c91 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:37 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Stopped (Lifecycle Event)
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-5bd042c3-6b5a-4546-8aaa-45dbbecc93aa None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-5bd042c3-6b5a-4546-8aaa-45dbbecc93aa None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-c07ece06-cd2b-4343-b040-a00819b67345 req-6124cd3d-9bf0-4669-9fb6-d03507792976 service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received event network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c07ece06-cd2b-4343-b040-a00819b67345 req-6124cd3d-9bf0-4669-9fb6-d03507792976 service nova] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c07ece06-cd2b-4343-b040-a00819b67345 req-6124cd3d-9bf0-4669-9fb6-d03507792976 service nova] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c07ece06-cd2b-4343-b040-a00819b67345 req-6124cd3d-9bf0-4669-9fb6-d03507792976 service nova] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-c07ece06-cd2b-4343-b040-a00819b67345 req-6124cd3d-9bf0-4669-9fb6-d03507792976 service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] No waiting events found dispatching network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:38 user nova-compute[73007]: WARNING nova.compute.manager [req-c07ece06-cd2b-4343-b040-a00819b67345 req-6124cd3d-9bf0-4669-9fb6-d03507792976 service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received unexpected event network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 for instance with vm_state building and task_state spawning.
Aug 15 17:49:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-4e708d1a-b1e4-412d-9f3a-bc2c3e3b7ca0 req-ad0500dd-3f2e-482b-b7ac-d44fc9be26fd service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received event network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4e708d1a-b1e4-412d-9f3a-bc2c3e3b7ca0 req-ad0500dd-3f2e-482b-b7ac-d44fc9be26fd service nova] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4e708d1a-b1e4-412d-9f3a-bc2c3e3b7ca0 req-ad0500dd-3f2e-482b-b7ac-d44fc9be26fd service nova] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4e708d1a-b1e4-412d-9f3a-bc2c3e3b7ca0 req-ad0500dd-3f2e-482b-b7ac-d44fc9be26fd service nova] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-4e708d1a-b1e4-412d-9f3a-bc2c3e3b7ca0 req-ad0500dd-3f2e-482b-b7ac-d44fc9be26fd service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] No waiting events found dispatching network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:40 user nova-compute[73007]: WARNING nova.compute.manager [req-4e708d1a-b1e4-412d-9f3a-bc2c3e3b7ca0 req-ad0500dd-3f2e-482b-b7ac-d44fc9be26fd service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received unexpected event network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 for instance with vm_state building and task_state spawning.
Aug 15 17:49:40 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121780.9695063, 582f3e3e-a05e-48dd-803d-b87a6eeda045 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:40 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] VM Resumed (Lifecycle Event)
Aug 15 17:49:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:49:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:49:40 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Instance spawned successfully.
Aug 15 17:49:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:49:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121780.9708629, 582f3e3e-a05e-48dd-803d-b87a6eeda045 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] VM Started (Lifecycle Event)
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:49:41 user nova-compute[73007]: INFO nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:49:41 user nova-compute[73007]: INFO nova.compute.manager [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Took 7.59 seconds to build instance.
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4b7a1101-e9f0-4634-b60e-01971d7ce52d tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.830s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:41 user nova-compute[73007]: INFO nova.compute.manager [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Terminating instance
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-73f43749-9bc3-46a7-b721-96888b07235f req-45180f2e-089b-4fdc-9169-4db278a0d8ff service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received event network-vif-unplugged-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-73f43749-9bc3-46a7-b721-96888b07235f req-45180f2e-089b-4fdc-9169-4db278a0d8ff service nova] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-73f43749-9bc3-46a7-b721-96888b07235f req-45180f2e-089b-4fdc-9169-4db278a0d8ff service nova] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-73f43749-9bc3-46a7-b721-96888b07235f req-45180f2e-089b-4fdc-9169-4db278a0d8ff service nova] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-73f43749-9bc3-46a7-b721-96888b07235f req-45180f2e-089b-4fdc-9169-4db278a0d8ff service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] No waiting events found dispatching network-vif-unplugged-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-73f43749-9bc3-46a7-b721-96888b07235f req-45180f2e-089b-4fdc-9169-4db278a0d8ff service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received event network-vif-unplugged-ec54f1b8-2099-4439-99f9-ab21931a1530 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Instance destroyed successfully.
Aug 15 17:49:42 user nova-compute[73007]: DEBUG nova.objects.instance [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lazy-loading 'resources' on Instance uuid 31637822-05e9-4762-b3b3-2bc6e49efb6e {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1838184703',display_name='tempest-VolumesAdminNegativeTest-server-1838184703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1838184703',id=6,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxENEjxthbGmc9/sXbnMSZscrX0MH4V++IMNQj3X4tOwSnMQTOfsTv1eWw49+grpZ+T7owCrFN9OHjI/fcjHB5XqbcqSUZ8pyUvvza9quRlz2tOBNTUwDmodk4VP/frvQ==',key_name='tempest-keypair-1986916607',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40320dc41a5b47339fe34ded685fba41',ramdisk_id='',reservation_id='r-8490wzrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2030731104',owner_user_name='tempest-VolumesAdminNegativeTest-2030731104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='22977501a17f4458bb5c8be69a2c26b4',uuid=31637822-05e9-4762-b3b3-2bc6e49efb6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converting VIF {"id": "ec54f1b8-2099-4439-99f9-ab21931a1530", "address": "fa:16:3e:8e:d9:bc", "network": {"id": "dd500177-5feb-454f-b2b2-4a0cc9cf1945", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1055060627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40320dc41a5b47339fe34ded685fba41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec54f1b8-20", "ovs_interfaceid": "ec54f1b8-2099-4439-99f9-ab21931a1530", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d9:bc,bridge_name='br-int',has_traffic_filtering=True,id=ec54f1b8-2099-4439-99f9-ab21931a1530,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec54f1b8-20') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG os_vif [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d9:bc,bridge_name='br-int',has_traffic_filtering=True,id=ec54f1b8-2099-4439-99f9-ab21931a1530,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec54f1b8-20') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec54f1b8-20, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:42 user nova-compute[73007]: INFO os_vif [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d9:bc,bridge_name='br-int',has_traffic_filtering=True,id=ec54f1b8-2099-4439-99f9-ab21931a1530,network=Network(dd500177-5feb-454f-b2b2-4a0cc9cf1945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec54f1b8-20')
Aug 15 17:49:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Deleting instance files /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e_del
Aug 15 17:49:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Deletion of /opt/stack/data/nova/instances/31637822-05e9-4762-b3b3-2bc6e49efb6e_del complete
Aug 15 17:49:42 user nova-compute[73007]: INFO nova.compute.manager [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 17:49:42 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:49:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-3bb042c1-3967-48b3-aadd-225c17076001 req-0c311d2c-bef3-4409-bb3d-9aaa9b32d3d8 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received event network-vif-deleted-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:43 user nova-compute[73007]: INFO nova.compute.manager [req-3bb042c1-3967-48b3-aadd-225c17076001 req-0c311d2c-bef3-4409-bb3d-9aaa9b32d3d8 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Neutron deleted interface ec54f1b8-2099-4439-99f9-ab21931a1530; detaching it from the instance and deleting it from the info cache
Aug 15 17:49:43 user nova-compute[73007]: DEBUG nova.network.neutron [req-3bb042c1-3967-48b3-aadd-225c17076001 req-0c311d2c-bef3-4409-bb3d-9aaa9b32d3d8 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:43 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Took 1.01 seconds to deallocate network for instance.
Aug 15 17:49:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-3bb042c1-3967-48b3-aadd-225c17076001 req-0c311d2c-bef3-4409-bb3d-9aaa9b32d3d8 service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Detach interface failed, port_id=ec54f1b8-2099-4439-99f9-ab21931a1530, reason: Instance 31637822-05e9-4762-b3b3-2bc6e49efb6e could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:43 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Deleted allocations for instance 31637822-05e9-4762-b3b3-2bc6e49efb6e
Aug 15 17:49:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-18da4d38-fbca-42a7-ad6a-92a6fd1c55eb tempest-VolumesAdminNegativeTest-2030731104 tempest-VolumesAdminNegativeTest-2030731104-project-member] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.469s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-c7e0e4eb-0550-42d6-a411-e060d845b1be req-7f1596bb-c4ca-4284-a16e-f32260f3c70e service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received event network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c7e0e4eb-0550-42d6-a411-e060d845b1be req-7f1596bb-c4ca-4284-a16e-f32260f3c70e service nova] Acquiring lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c7e0e4eb-0550-42d6-a411-e060d845b1be req-7f1596bb-c4ca-4284-a16e-f32260f3c70e service nova] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c7e0e4eb-0550-42d6-a411-e060d845b1be req-7f1596bb-c4ca-4284-a16e-f32260f3c70e service nova] Lock "31637822-05e9-4762-b3b3-2bc6e49efb6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-c7e0e4eb-0550-42d6-a411-e060d845b1be req-7f1596bb-c4ca-4284-a16e-f32260f3c70e service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] No waiting events found dispatching network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:43 user nova-compute[73007]: WARNING nova.compute.manager [req-c7e0e4eb-0550-42d6-a411-e060d845b1be req-7f1596bb-c4ca-4284-a16e-f32260f3c70e service nova] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Received unexpected event network-vif-plugged-ec54f1b8-2099-4439-99f9-ab21931a1530 for instance with vm_state deleted and task_state None.
Aug 15 17:49:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:45 user nova-compute[73007]: INFO nova.compute.manager [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Detaching volume 44ce30f1-39e1-448b-a041-b0f7bd1779ea
Aug 15 17:49:45 user nova-compute[73007]: INFO nova.virt.block_device [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Attempting to driver detach volume 44ce30f1-39e1-448b-a041-b0f7bd1779ea from mountpoint /dev/vdb
Aug 15 17:49:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Attempting to detach device vdb from instance 6b14b5d1-a493-4506-be76-029324a5aadd from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:49:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:49:45 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:45 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 17:49:45 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:49:45 user nova-compute[73007]:   <serial>44ce30f1-39e1-448b-a041-b0f7bd1779ea</serial>
Aug 15 17:49:45 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:49:45 user nova-compute[73007]: </disk>
Aug 15 17:49:45 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Successfully detached device vdb from instance 6b14b5d1-a493-4506-be76-029324a5aadd from the persistent domain config.
Aug 15 17:49:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b14b5d1-a493-4506-be76-029324a5aadd from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:49:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:49:45 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:49:45 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 17:49:45 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:49:45 user nova-compute[73007]:   <serial>44ce30f1-39e1-448b-a041-b0f7bd1779ea</serial>
Aug 15 17:49:45 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:49:45 user nova-compute[73007]: </disk>
Aug 15 17:49:45 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121786.0955045, 6b14b5d1-a493-4506-be76-029324a5aadd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:49:46 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Successfully detached device vdb from instance 6b14b5d1-a493-4506-be76-029324a5aadd from the live domain config.
Aug 15 17:49:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYcNbAwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:49:46 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5632a41-c59b-4bd3-8a01-afb05f43eb33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b66d3-14cd-4b51-8f26-491260d81cbe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea (non-flash)
Aug 15 17:49:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11581a5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea'): ({'sdc'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Removing single pathed devices sdc {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ff256f-3e01-4fe7-b7ab-ce5c882a8d6f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fbbb5d-04e8-45ab-8862-82d0e1331f40]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Flushing IO for device /dev/sdc {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5570869e-04d0-400e-9a1f-d69f7745792c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16c8ccb-2e56-4542-a18c-b37a71b0c890]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[abad78b0-b334-4296-8408-7b179da3d38c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[098ffa4b-ffa4-4e50-9518-e02a3355afa5]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea, portal: 172.16.0.220,3260]
Aug 15 17:49:46 user nova-compute[73007]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea, portal: 172.16.0.220,3260] successful.
Aug 15 17:49:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44ce30f1-39e1-448b-a041-b0f7bd1779ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6be7c0-dad3-4793-ab12-5dbaa9b3a160]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] <== disconnect_volume: return (279ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:49:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:49:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:47 user nova-compute[73007]: DEBUG nova.objects.instance [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'flavor' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3b37919-8e80-4a36-bf69-e372056df188 tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.695s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:52 user nova-compute[73007]: INFO nova.compute.manager [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Terminating instance
Aug 15 17:49:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-f6e3e4a7-b34a-48ef-a913-6c6128b8489c req-e78eb8ae-ecd4-49c9-aa76-8127f1494837 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-unplugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f6e3e4a7-b34a-48ef-a913-6c6128b8489c req-e78eb8ae-ecd4-49c9-aa76-8127f1494837 service nova] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f6e3e4a7-b34a-48ef-a913-6c6128b8489c req-e78eb8ae-ecd4-49c9-aa76-8127f1494837 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f6e3e4a7-b34a-48ef-a913-6c6128b8489c req-e78eb8ae-ecd4-49c9-aa76-8127f1494837 service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-f6e3e4a7-b34a-48ef-a913-6c6128b8489c req-e78eb8ae-ecd4-49c9-aa76-8127f1494837 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] No waiting events found dispatching network-vif-unplugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-f6e3e4a7-b34a-48ef-a913-6c6128b8489c req-e78eb8ae-ecd4-49c9-aa76-8127f1494837 service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-unplugged-ddf68e4b-1015-4964-9b62-d41585fd04fc for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:49:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Instance destroyed successfully.
Aug 15 17:49:52 user nova-compute[73007]: DEBUG nova.objects.instance [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'resources' on Instance uuid a82e6742-fe31-4693-8db5-50dc97f6072c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-808387531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-808387531',id=2,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiWEFDUTizVa6mi6X2e8otnDTG491szA8E97zyePRTalDLnNNs2ZAC8znJJ0grfy7VMp8BwtMHD/veSKaeDPORLqU4usx4qvYLND4S2EsVvZAWztlqq8rgYjlGoxNrIVQ==',key_name='tempest-keypair-21307621',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-p93ff0q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:47:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=a82e6742-fe31-4693-8db5-50dc97f6072c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "address": "fa:16:3e:2e:2c:d6", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf68e4b-10", "ovs_interfaceid": "ddf68e4b-1015-4964-9b62-d41585fd04fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG os_vif [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf68e4b-10, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:52 user nova-compute[73007]: INFO os_vif [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2c:d6,bridge_name='br-int',has_traffic_filtering=True,id=ddf68e4b-1015-4964-9b62-d41585fd04fc,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf68e4b-10')
Aug 15 17:49:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Deleting instance files /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c_del
Aug 15 17:49:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Deletion of /opt/stack/data/nova/instances/a82e6742-fe31-4693-8db5-50dc97f6072c_del complete
Aug 15 17:49:53 user nova-compute[73007]: INFO nova.compute.manager [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 17:49:53 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:49:53 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:49:53 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:49:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "99297e55-b8a9-4b15-9afe-724a494228a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "99297e55-b8a9-4b15-9afe-724a494228a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:49:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:53 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:49:53 user nova-compute[73007]: INFO nova.compute.claims [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Claim successful on node user
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.network.neutron [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:49:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:49:54 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Took 1.14 seconds to deallocate network for instance.
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.policy [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f02af903ce234948b57be7978398f8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b56c9a439844149abcefe8703cdc906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:49:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Creating image(s)
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "/opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "/opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "/opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk 1073741824" returned: 0 in 0.054s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:54 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Deleted allocations for instance a82e6742-fe31-4693-8db5-50dc97f6072c
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-eb3197d7-d901-47e0-bec5-10982d42fb9e tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.759s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-c9715193-7221-44bf-b778-aa2f3261633e req-eb7024ea-e780-46a3-88ef-e411bceb11fb service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c9715193-7221-44bf-b778-aa2f3261633e req-eb7024ea-e780-46a3-88ef-e411bceb11fb service nova] Acquiring lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c9715193-7221-44bf-b778-aa2f3261633e req-eb7024ea-e780-46a3-88ef-e411bceb11fb service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c9715193-7221-44bf-b778-aa2f3261633e req-eb7024ea-e780-46a3-88ef-e411bceb11fb service nova] Lock "a82e6742-fe31-4693-8db5-50dc97f6072c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-c9715193-7221-44bf-b778-aa2f3261633e req-eb7024ea-e780-46a3-88ef-e411bceb11fb service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] No waiting events found dispatching network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:54 user nova-compute[73007]: WARNING nova.compute.manager [req-c9715193-7221-44bf-b778-aa2f3261633e req-eb7024ea-e780-46a3-88ef-e411bceb11fb service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received unexpected event network-vif-plugged-ddf68e4b-1015-4964-9b62-d41585fd04fc for instance with vm_state deleted and task_state None.
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-c9715193-7221-44bf-b778-aa2f3261633e req-eb7024ea-e780-46a3-88ef-e411bceb11fb service nova] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Received event network-vif-deleted-ddf68e4b-1015-4964-9b62-d41585fd04fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:49:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Cannot resize image /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG nova.objects.instance [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lazy-loading 'migration_context' on Instance uuid 99297e55-b8a9-4b15-9afe-724a494228a6 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Ensure instance console log exists: /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:55 user nova-compute[73007]: DEBUG nova.network.neutron [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Successfully created port: 7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.network.neutron [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Successfully updated port: 7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "refresh_cache-99297e55-b8a9-4b15-9afe-724a494228a6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquired lock "refresh_cache-99297e55-b8a9-4b15-9afe-724a494228a6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.network.neutron [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.network.neutron [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.network.neutron [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Updating instance_info_cache with network_info: [{"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Releasing lock "refresh_cache-99297e55-b8a9-4b15-9afe-724a494228a6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Instance network_info: |[{"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Start _get_guest_xml network_info=[{"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:49:56 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:56 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-507384064',display_name='tempest-ServersNegativeTestJSON-server-507384064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-507384064',id=21,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b56c9a439844149abcefe8703cdc906',ramdisk_id='',reservation_id='r-z9lj0x0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1246805643',owner_user_name='tempest-ServersNegativeTestJSON-1246805643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:54Z,user_data=None,user_id='f02af903ce234948b57be7978398f8e8',uuid=99297e55-b8a9-4b15-9afe-724a494228a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converting VIF {"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:5f:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d07fe9f-b079-4022-8b38-0bccc81c1045,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d07fe9f-b0') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.objects.instance [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lazy-loading 'pci_devices' on Instance uuid 99297e55-b8a9-4b15-9afe-724a494228a6 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:49:56 user nova-compute[73007]:   <uuid>99297e55-b8a9-4b15-9afe-724a494228a6</uuid>
Aug 15 17:49:56 user nova-compute[73007]:   <name>instance-00000015</name>
Aug 15 17:49:56 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:49:56 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:49:56 user nova-compute[73007]:   <metadata>
Aug 15 17:49:56 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:49:56 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:49:56 user nova-compute[73007]:       <nova:name>tempest-ServersNegativeTestJSON-server-507384064</nova:name>
Aug 15 17:49:56 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:49:56</nova:creationTime>
Aug 15 17:49:56 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:49:56 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:49:56 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:49:56 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:49:56 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:49:56 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:49:56 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:49:56 user nova-compute[73007]:       <nova:owner>
Aug 15 17:49:56 user nova-compute[73007]:         <nova:user uuid="f02af903ce234948b57be7978398f8e8">tempest-ServersNegativeTestJSON-1246805643-project-member</nova:user>
Aug 15 17:49:56 user nova-compute[73007]:         <nova:project uuid="0b56c9a439844149abcefe8703cdc906">tempest-ServersNegativeTestJSON-1246805643</nova:project>
Aug 15 17:49:56 user nova-compute[73007]:       </nova:owner>
Aug 15 17:49:56 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:49:56 user nova-compute[73007]:       <nova:ports>
Aug 15 17:49:56 user nova-compute[73007]:         <nova:port uuid="7d07fe9f-b079-4022-8b38-0bccc81c1045">
Aug 15 17:49:56 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 17:49:56 user nova-compute[73007]:         </nova:port>
Aug 15 17:49:56 user nova-compute[73007]:       </nova:ports>
Aug 15 17:49:56 user nova-compute[73007]:     </nova:instance>
Aug 15 17:49:56 user nova-compute[73007]:   </metadata>
Aug 15 17:49:56 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:49:56 user nova-compute[73007]:     <system>
Aug 15 17:49:56 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:49:56 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:49:56 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:49:56 user nova-compute[73007]:       <entry name="serial">99297e55-b8a9-4b15-9afe-724a494228a6</entry>
Aug 15 17:49:56 user nova-compute[73007]:       <entry name="uuid">99297e55-b8a9-4b15-9afe-724a494228a6</entry>
Aug 15 17:49:56 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:49:56 user nova-compute[73007]:     </system>
Aug 15 17:49:56 user nova-compute[73007]:   </sysinfo>
Aug 15 17:49:56 user nova-compute[73007]:   <os>
Aug 15 17:49:56 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:49:56 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:49:56 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:49:56 user nova-compute[73007]:   </os>
Aug 15 17:49:56 user nova-compute[73007]:   <features>
Aug 15 17:49:56 user nova-compute[73007]:     <acpi/>
Aug 15 17:49:56 user nova-compute[73007]:     <apic/>
Aug 15 17:49:56 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:49:56 user nova-compute[73007]:   </features>
Aug 15 17:49:56 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:49:56 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:49:56 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:49:56 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:49:56 user nova-compute[73007]:   </clock>
Aug 15 17:49:56 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:49:56 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:49:56 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:49:56 user nova-compute[73007]:   </cpu>
Aug 15 17:49:56 user nova-compute[73007]:   <devices>
Aug 15 17:49:56 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:49:56 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:49:56 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk"/>
Aug 15 17:49:56 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:49:56 user nova-compute[73007]:     </disk>
Aug 15 17:49:56 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:49:56 user nova-compute[73007]:       <mac address="fa:16:3e:85:5f:a1"/>
Aug 15 17:49:56 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:56 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:49:56 user nova-compute[73007]:       <target dev="tap7d07fe9f-b0"/>
Aug 15 17:49:56 user nova-compute[73007]:     </interface>
Aug 15 17:49:56 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:49:56 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/console.log" append="off"/>
Aug 15 17:49:56 user nova-compute[73007]:     </serial>
Aug 15 17:49:56 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:49:56 user nova-compute[73007]:     <video>
Aug 15 17:49:56 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:49:56 user nova-compute[73007]:     </video>
Aug 15 17:49:56 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:49:56 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:49:56 user nova-compute[73007]:     </rng>
Aug 15 17:49:56 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:49:56 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:49:56 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:49:56 user nova-compute[73007]:     </memballoon>
Aug 15 17:49:56 user nova-compute[73007]:   </devices>
Aug 15 17:49:56 user nova-compute[73007]: </domain>
Aug 15 17:49:56 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-507384064',display_name='tempest-ServersNegativeTestJSON-server-507384064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-507384064',id=21,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b56c9a439844149abcefe8703cdc906',ramdisk_id='',reservation_id='r-z9lj0x0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1246805643',owner_user_name='tempest-ServersNegativeTestJSON-1246805643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:54Z,user_data=None,user_id='f02af903ce234948b57be7978398f8e8',uuid=99297e55-b8a9-4b15-9afe-724a494228a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converting VIF {"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:5f:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d07fe9f-b079-4022-8b38-0bccc81c1045,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d07fe9f-b0') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG os_vif [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:5f:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d07fe9f-b079-4022-8b38-0bccc81c1045,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d07fe9f-b0') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d07fe9f-b0, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d07fe9f-b0, col_values=(('external_ids', {'iface-id': '7d07fe9f-b079-4022-8b38-0bccc81c1045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:5f:a1', 'vm-uuid': '99297e55-b8a9-4b15-9afe-724a494228a6'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:49:56 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121781.996179, 31637822-05e9-4762-b3b3-2bc6e49efb6e => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:49:56 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] VM Stopped (Lifecycle Event)
Aug 15 17:49:57 user nova-compute[73007]: DEBUG nova.compute.manager [req-a2010cbe-d703-48db-8f31-0a1dfdfbd6b2 req-fd85fd72-86a7-4cc7-ac9d-7f9a4c3414c9 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received event network-changed-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG nova.compute.manager [req-a2010cbe-d703-48db-8f31-0a1dfdfbd6b2 req-fd85fd72-86a7-4cc7-ac9d-7f9a4c3414c9 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Refreshing instance network info cache due to event network-changed-7d07fe9f-b079-4022-8b38-0bccc81c1045. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a2010cbe-d703-48db-8f31-0a1dfdfbd6b2 req-fd85fd72-86a7-4cc7-ac9d-7f9a4c3414c9 service nova] Acquiring lock "refresh_cache-99297e55-b8a9-4b15-9afe-724a494228a6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a2010cbe-d703-48db-8f31-0a1dfdfbd6b2 req-fd85fd72-86a7-4cc7-ac9d-7f9a4c3414c9 service nova] Acquired lock "refresh_cache-99297e55-b8a9-4b15-9afe-724a494228a6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG nova.network.neutron [req-a2010cbe-d703-48db-8f31-0a1dfdfbd6b2 req-fd85fd72-86a7-4cc7-ac9d-7f9a4c3414c9 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Refreshing network info cache for port 7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:57 user nova-compute[73007]: INFO os_vif [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:5f:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d07fe9f-b079-4022-8b38-0bccc81c1045,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d07fe9f-b0')
Aug 15 17:49:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-87c979ae-62b2-4fc4-a6a3-40aff4998d62 None None] [instance: 31637822-05e9-4762-b3b3-2bc6e49efb6e] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] No VIF found with MAC fa:16:3e:85:5f:a1, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG nova.network.neutron [req-a2010cbe-d703-48db-8f31-0a1dfdfbd6b2 req-fd85fd72-86a7-4cc7-ac9d-7f9a4c3414c9 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Updated VIF entry in instance network info cache for port 7d07fe9f-b079-4022-8b38-0bccc81c1045. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG nova.network.neutron [req-a2010cbe-d703-48db-8f31-0a1dfdfbd6b2 req-fd85fd72-86a7-4cc7-ac9d-7f9a4c3414c9 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Updating instance_info_cache with network_info: [{"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a2010cbe-d703-48db-8f31-0a1dfdfbd6b2 req-fd85fd72-86a7-4cc7-ac9d-7f9a4c3414c9 service nova] Releasing lock "refresh_cache-99297e55-b8a9-4b15-9afe-724a494228a6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:49:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-c32c216b-f825-4bd4-80d5-d93b558fd17f req-2e9240af-5800-4209-9b9a-75348d5aa2ab service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received event network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c32c216b-f825-4bd4-80d5-d93b558fd17f req-2e9240af-5800-4209-9b9a-75348d5aa2ab service nova] Acquiring lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c32c216b-f825-4bd4-80d5-d93b558fd17f req-2e9240af-5800-4209-9b9a-75348d5aa2ab service nova] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c32c216b-f825-4bd4-80d5-d93b558fd17f req-2e9240af-5800-4209-9b9a-75348d5aa2ab service nova] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-c32c216b-f825-4bd4-80d5-d93b558fd17f req-2e9240af-5800-4209-9b9a-75348d5aa2ab service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] No waiting events found dispatching network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:49:58 user nova-compute[73007]: WARNING nova.compute.manager [req-c32c216b-f825-4bd4-80d5-d93b558fd17f req-2e9240af-5800-4209-9b9a-75348d5aa2ab service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received unexpected event network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 for instance with vm_state building and task_state spawning.
Aug 15 17:49:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:49:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121800.46896, 99297e55-b8a9-4b15-9afe-724a494228a6 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:00 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] VM Resumed (Lifecycle Event)
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:50:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Instance spawned successfully.
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:00 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121800.4706457, 99297e55-b8a9-4b15-9afe-724a494228a6 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:00 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] VM Started (Lifecycle Event)
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:50:00 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:50:00 user nova-compute[73007]: INFO nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Took 6.25 seconds to spawn the instance on the hypervisor.
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:00 user nova-compute[73007]: INFO nova.compute.manager [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Took 7.12 seconds to build instance.
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-8ef165ac-9e5f-4cc0-b80e-de293a05a99b req-6b7c9c53-ee23-4870-a7ce-78226da9445d service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received event network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ef165ac-9e5f-4cc0-b80e-de293a05a99b req-6b7c9c53-ee23-4870-a7ce-78226da9445d service nova] Acquiring lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ef165ac-9e5f-4cc0-b80e-de293a05a99b req-6b7c9c53-ee23-4870-a7ce-78226da9445d service nova] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ef165ac-9e5f-4cc0-b80e-de293a05a99b req-6b7c9c53-ee23-4870-a7ce-78226da9445d service nova] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-8ef165ac-9e5f-4cc0-b80e-de293a05a99b req-6b7c9c53-ee23-4870-a7ce-78226da9445d service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] No waiting events found dispatching network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:00 user nova-compute[73007]: WARNING nova.compute.manager [req-8ef165ac-9e5f-4cc0-b80e-de293a05a99b req-6b7c9c53-ee23-4870-a7ce-78226da9445d service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received unexpected event network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 for instance with vm_state active and task_state None.
Aug 15 17:50:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-894dde98-edb9-40cb-b26d-4315851655e4 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "99297e55-b8a9-4b15-9afe-724a494228a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.355s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 64379e41-9e78-4389-aee2-14388d2366d5 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 384f0339-eed5-4573-90fb-1dd91c4cce90 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 582f3e3e-a05e-48dd-803d-b87a6eeda045 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 99297e55-b8a9-4b15-9afe-724a494228a6 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "64379e41-9e78-4389-aee2-14388d2366d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "64379e41-9e78-4389-aee2-14388d2366d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "99297e55-b8a9-4b15-9afe-724a494228a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "99297e55-b8a9-4b15-9afe-724a494228a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "64379e41-9e78-4389-aee2-14388d2366d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "99297e55-b8a9-4b15-9afe-724a494228a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:50:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:50:04 user nova-compute[73007]: INFO nova.compute.claims [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Claim successful on node user
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:50:05 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.policy [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82906484a46f4ad0be9a602aec2affb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa702dd2884da4b28a84db913819b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:50:05 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Creating image(s)
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "/opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "/opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk 1073741824" returned: 0 in 0.058s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Successfully created port: 6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Cannot resize image /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'migration_context' on Instance uuid eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Ensure instance console log exists: /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Successfully updated port: 6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquired lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:50:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-6206553e-2fd1-4624-8988-7948f3f644a2 req-16df5aeb-24d3-4c52-a2de-38c6f6204614 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received event network-changed-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-6206553e-2fd1-4624-8988-7948f3f644a2 req-16df5aeb-24d3-4c52-a2de-38c6f6204614 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Refreshing instance network info cache due to event network-changed-6510aa47-8337-470f-bf79-62a651835537. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6206553e-2fd1-4624-8988-7948f3f644a2 req-16df5aeb-24d3-4c52-a2de-38c6f6204614 service nova] Acquiring lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Updating instance_info_cache with network_info: [{"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Releasing lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Instance network_info: |[{"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6206553e-2fd1-4624-8988-7948f3f644a2 req-16df5aeb-24d3-4c52-a2de-38c6f6204614 service nova] Acquired lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-6206553e-2fd1-4624-8988-7948f3f644a2 req-16df5aeb-24d3-4c52-a2de-38c6f6204614 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Refreshing network info cache for port 6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Start _get_guest_xml network_info=[{"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:50:07 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:50:07 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1021287927',display_name='tempest-AttachVolumeNegativeTest-server-1021287927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1021287927',id=22,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBYTjTo1YUPIP+SfbbllpHnABDT4o3XQ7M6PaaVHQi8d7SnZX3eMUUiLCW0CXw1kRd20gTozUH4VX53aHKTUnq/C/mG18cs5Ftjmjk4OS4pOrYAqobqQBjoZRJ37fpn2Q==',key_name='tempest-keypair-1804934813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-tv1ehvml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:48:83,bridge_name='br-int',has_traffic_filtering=True,id=6510aa47-8337-470f-bf79-62a651835537,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510aa47-83') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'pci_devices' on Instance uuid eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:50:07 user nova-compute[73007]:   <uuid>eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a</uuid>
Aug 15 17:50:07 user nova-compute[73007]:   <name>instance-00000016</name>
Aug 15 17:50:07 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:50:07 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:50:07 user nova-compute[73007]:   <metadata>
Aug 15 17:50:07 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:50:07 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:50:07 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1021287927</nova:name>
Aug 15 17:50:07 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:50:07</nova:creationTime>
Aug 15 17:50:07 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:50:07 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:50:07 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:50:07 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:50:07 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:50:07 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:50:07 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:50:07 user nova-compute[73007]:       <nova:owner>
Aug 15 17:50:07 user nova-compute[73007]:         <nova:user uuid="82906484a46f4ad0be9a602aec2affb6">tempest-AttachVolumeNegativeTest-1698859108-project-member</nova:user>
Aug 15 17:50:07 user nova-compute[73007]:         <nova:project uuid="1bfa702dd2884da4b28a84db913819b6">tempest-AttachVolumeNegativeTest-1698859108</nova:project>
Aug 15 17:50:07 user nova-compute[73007]:       </nova:owner>
Aug 15 17:50:07 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:50:07 user nova-compute[73007]:       <nova:ports>
Aug 15 17:50:07 user nova-compute[73007]:         <nova:port uuid="6510aa47-8337-470f-bf79-62a651835537">
Aug 15 17:50:07 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:50:07 user nova-compute[73007]:         </nova:port>
Aug 15 17:50:07 user nova-compute[73007]:       </nova:ports>
Aug 15 17:50:07 user nova-compute[73007]:     </nova:instance>
Aug 15 17:50:07 user nova-compute[73007]:   </metadata>
Aug 15 17:50:07 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:50:07 user nova-compute[73007]:     <system>
Aug 15 17:50:07 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:50:07 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:50:07 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:50:07 user nova-compute[73007]:       <entry name="serial">eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a</entry>
Aug 15 17:50:07 user nova-compute[73007]:       <entry name="uuid">eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a</entry>
Aug 15 17:50:07 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:50:07 user nova-compute[73007]:     </system>
Aug 15 17:50:07 user nova-compute[73007]:   </sysinfo>
Aug 15 17:50:07 user nova-compute[73007]:   <os>
Aug 15 17:50:07 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:50:07 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:50:07 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:50:07 user nova-compute[73007]:   </os>
Aug 15 17:50:07 user nova-compute[73007]:   <features>
Aug 15 17:50:07 user nova-compute[73007]:     <acpi/>
Aug 15 17:50:07 user nova-compute[73007]:     <apic/>
Aug 15 17:50:07 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:50:07 user nova-compute[73007]:   </features>
Aug 15 17:50:07 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:50:07 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:50:07 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:50:07 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:50:07 user nova-compute[73007]:   </clock>
Aug 15 17:50:07 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:50:07 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:50:07 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:50:07 user nova-compute[73007]:   </cpu>
Aug 15 17:50:07 user nova-compute[73007]:   <devices>
Aug 15 17:50:07 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:50:07 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:50:07 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk"/>
Aug 15 17:50:07 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:50:07 user nova-compute[73007]:     </disk>
Aug 15 17:50:07 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:50:07 user nova-compute[73007]:       <mac address="fa:16:3e:e5:48:83"/>
Aug 15 17:50:07 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:50:07 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:50:07 user nova-compute[73007]:       <target dev="tap6510aa47-83"/>
Aug 15 17:50:07 user nova-compute[73007]:     </interface>
Aug 15 17:50:07 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:50:07 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/console.log" append="off"/>
Aug 15 17:50:07 user nova-compute[73007]:     </serial>
Aug 15 17:50:07 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:50:07 user nova-compute[73007]:     <video>
Aug 15 17:50:07 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:50:07 user nova-compute[73007]:     </video>
Aug 15 17:50:07 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:50:07 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:50:07 user nova-compute[73007]:     </rng>
Aug 15 17:50:07 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:50:07 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:50:07 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:50:07 user nova-compute[73007]:     </memballoon>
Aug 15 17:50:07 user nova-compute[73007]:   </devices>
Aug 15 17:50:07 user nova-compute[73007]: </domain>
Aug 15 17:50:07 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1021287927',display_name='tempest-AttachVolumeNegativeTest-server-1021287927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1021287927',id=22,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBYTjTo1YUPIP+SfbbllpHnABDT4o3XQ7M6PaaVHQi8d7SnZX3eMUUiLCW0CXw1kRd20gTozUH4VX53aHKTUnq/C/mG18cs5Ftjmjk4OS4pOrYAqobqQBjoZRJ37fpn2Q==',key_name='tempest-keypair-1804934813',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-tv1ehvml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:48:83,bridge_name='br-int',has_traffic_filtering=True,id=6510aa47-8337-470f-bf79-62a651835537,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510aa47-83') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG os_vif [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:48:83,bridge_name='br-int',has_traffic_filtering=True,id=6510aa47-8337-470f-bf79-62a651835537,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510aa47-83') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6510aa47-83, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6510aa47-83, col_values=(('external_ids', {'iface-id': '6510aa47-8337-470f-bf79-62a651835537', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:48:83', 'vm-uuid': 'eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:07 user nova-compute[73007]: INFO os_vif [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:48:83,bridge_name='br-int',has_traffic_filtering=True,id=6510aa47-8337-470f-bf79-62a651835537,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510aa47-83')
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No VIF found with MAC fa:16:3e:e5:48:83, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121792.9426568, a82e6742-fe31-4693-8db5-50dc97f6072c => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:07 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] VM Stopped (Lifecycle Event)
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-05bbd6ce-4461-44e1-9173-813c27207e7c None None] [instance: a82e6742-fe31-4693-8db5-50dc97f6072c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-6206553e-2fd1-4624-8988-7948f3f644a2 req-16df5aeb-24d3-4c52-a2de-38c6f6204614 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Updated VIF entry in instance network info cache for port 6510aa47-8337-470f-bf79-62a651835537. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-6206553e-2fd1-4624-8988-7948f3f644a2 req-16df5aeb-24d3-4c52-a2de-38c6f6204614 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Updating instance_info_cache with network_info: [{"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6206553e-2fd1-4624-8988-7948f3f644a2 req-16df5aeb-24d3-4c52-a2de-38c6f6204614 service nova] Releasing lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-8c8fcccb-928f-4323-8262-e70239535d96 req-fa203e69-c5bb-409f-855f-0d0a2e5c90eb service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received event network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c8fcccb-928f-4323-8262-e70239535d96 req-fa203e69-c5bb-409f-855f-0d0a2e5c90eb service nova] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c8fcccb-928f-4323-8262-e70239535d96 req-fa203e69-c5bb-409f-855f-0d0a2e5c90eb service nova] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c8fcccb-928f-4323-8262-e70239535d96 req-fa203e69-c5bb-409f-855f-0d0a2e5c90eb service nova] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-8c8fcccb-928f-4323-8262-e70239535d96 req-fa203e69-c5bb-409f-855f-0d0a2e5c90eb service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] No waiting events found dispatching network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:09 user nova-compute[73007]: WARNING nova.compute.manager [req-8c8fcccb-928f-4323-8262-e70239535d96 req-fa203e69-c5bb-409f-855f-0d0a2e5c90eb service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received unexpected event network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 for instance with vm_state building and task_state spawning.
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121811.6649945, eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:11 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] VM Resumed (Lifecycle Event)
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-99e6ee3b-3004-4cb2-81f7-866520563caa req-7df51727-832a-4777-b780-1cecfbf49d3b service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received event network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-99e6ee3b-3004-4cb2-81f7-866520563caa req-7df51727-832a-4777-b780-1cecfbf49d3b service nova] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-99e6ee3b-3004-4cb2-81f7-866520563caa req-7df51727-832a-4777-b780-1cecfbf49d3b service nova] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-99e6ee3b-3004-4cb2-81f7-866520563caa req-7df51727-832a-4777-b780-1cecfbf49d3b service nova] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-99e6ee3b-3004-4cb2-81f7-866520563caa req-7df51727-832a-4777-b780-1cecfbf49d3b service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] No waiting events found dispatching network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:11 user nova-compute[73007]: WARNING nova.compute.manager [req-99e6ee3b-3004-4cb2-81f7-866520563caa req-7df51727-832a-4777-b780-1cecfbf49d3b service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received unexpected event network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 for instance with vm_state building and task_state spawning.
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:50:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Instance spawned successfully.
Aug 15 17:50:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:50:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7329MB free_disk=25.417987823486328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:11 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121811.666328, eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:11 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] VM Started (Lifecycle Event)
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:50:11 user nova-compute[73007]: INFO nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Took 6.63 seconds to spawn the instance on the hypervisor.
Aug 15 17:50:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:12 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6b14b5d1-a493-4506-be76-029324a5aadd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 2f4c50b0-1153-4b59-89d6-2192e5653827 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 35fd679b-f098-4905-aa23-1fce430265bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 384f0339-eed5-4573-90fb-1dd91c4cce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 99297e55-b8a9-4b15-9afe-724a494228a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:50:12 user nova-compute[73007]: INFO nova.compute.manager [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Took 7.47 seconds to build instance.
Aug 15 17:50:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c50ef62f-1ef9-4be0-af80-eb0d7cbfd545 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.574s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:17 user nova-compute[73007]: INFO nova.compute.manager [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Terminating instance
Aug 15 17:50:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-253a4451-2650-4493-abca-f0824a3cc0e2 req-536f09ca-655b-4fa2-9edc-e0c86c8c69e2 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-unplugged-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-253a4451-2650-4493-abca-f0824a3cc0e2 req-536f09ca-655b-4fa2-9edc-e0c86c8c69e2 service nova] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-253a4451-2650-4493-abca-f0824a3cc0e2 req-536f09ca-655b-4fa2-9edc-e0c86c8c69e2 service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-253a4451-2650-4493-abca-f0824a3cc0e2 req-536f09ca-655b-4fa2-9edc-e0c86c8c69e2 service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-253a4451-2650-4493-abca-f0824a3cc0e2 req-536f09ca-655b-4fa2-9edc-e0c86c8c69e2 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] No waiting events found dispatching network-vif-unplugged-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-253a4451-2650-4493-abca-f0824a3cc0e2 req-536f09ca-655b-4fa2-9edc-e0c86c8c69e2 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-unplugged-39025734-6212-4fa0-8dff-4a91a091bdfb for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:50:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Instance destroyed successfully.
Aug 15 17:50:18 user nova-compute[73007]: DEBUG nova.objects.instance [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lazy-loading 'resources' on Instance uuid 2f4c50b0-1153-4b59-89d6-2192e5653827 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T17:47:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1208169056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1208169056',id=15,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFULtt2hh+zKfdqJDbMaFFRRCJ8HIVkds0eQek0lX9N+sd/fctN29bC7cNi6qnvCHyU+9cOpLu0Efftjn9orZVah1vdMZ+pntb6oFeNDGxXefOeSCpO03TDcsQ2AzQeB+g==',key_name='tempest-keypair-1558067036',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='189c104825c64a5a86cb9f3e3c4d55a4',ramdisk_id='',reservation_id='r-y8j5q5a1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1156291487',owner_user_name='tempest-TaggedAttachmentsTest-1156291487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f75799308247a5a796ef4c8530b6d8',uuid=2f4c50b0-1153-4b59-89d6-2192e5653827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converting VIF {"id": "39025734-6212-4fa0-8dff-4a91a091bdfb", "address": "fa:16:3e:cd:97:38", "network": {"id": "18dc52e1-1158-441d-8f8a-07f36eaa206c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1908690236-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "189c104825c64a5a86cb9f3e3c4d55a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39025734-62", "ovs_interfaceid": "39025734-6212-4fa0-8dff-4a91a091bdfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:97:38,bridge_name='br-int',has_traffic_filtering=True,id=39025734-6212-4fa0-8dff-4a91a091bdfb,network=Network(18dc52e1-1158-441d-8f8a-07f36eaa206c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39025734-62') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG os_vif [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:97:38,bridge_name='br-int',has_traffic_filtering=True,id=39025734-6212-4fa0-8dff-4a91a091bdfb,network=Network(18dc52e1-1158-441d-8f8a-07f36eaa206c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39025734-62') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39025734-62, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:18 user nova-compute[73007]: INFO os_vif [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:97:38,bridge_name='br-int',has_traffic_filtering=True,id=39025734-6212-4fa0-8dff-4a91a091bdfb,network=Network(18dc52e1-1158-441d-8f8a-07f36eaa206c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39025734-62')
Aug 15 17:50:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Deleting instance files /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827_del
Aug 15 17:50:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Deletion of /opt/stack/data/nova/instances/2f4c50b0-1153-4b59-89d6-2192e5653827_del complete
Aug 15 17:50:18 user nova-compute[73007]: INFO nova.compute.manager [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 17:50:18 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:50:18 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:19 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Took 1.14 seconds to deallocate network for instance.
Aug 15 17:50:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0217b7c-0665-4ae1-99f5-f5635d865c57 req-4c218634-f269-485e-bc8e-941eb52401c5 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-deleted-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:19 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Deleted allocations for instance 2f4c50b0-1153-4b59-89d6-2192e5653827
Aug 15 17:50:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-cd9caa02-3644-4f44-ae7e-0efa0e499cf5 req-db1e5697-6d0f-482a-9ffa-d221ca2be8d1 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received event network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cd9caa02-3644-4f44-ae7e-0efa0e499cf5 req-db1e5697-6d0f-482a-9ffa-d221ca2be8d1 service nova] Acquiring lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cd9caa02-3644-4f44-ae7e-0efa0e499cf5 req-db1e5697-6d0f-482a-9ffa-d221ca2be8d1 service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cd9caa02-3644-4f44-ae7e-0efa0e499cf5 req-db1e5697-6d0f-482a-9ffa-d221ca2be8d1 service nova] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-cd9caa02-3644-4f44-ae7e-0efa0e499cf5 req-db1e5697-6d0f-482a-9ffa-d221ca2be8d1 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] No waiting events found dispatching network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:19 user nova-compute[73007]: WARNING nova.compute.manager [req-cd9caa02-3644-4f44-ae7e-0efa0e499cf5 req-db1e5697-6d0f-482a-9ffa-d221ca2be8d1 service nova] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Received unexpected event network-vif-plugged-39025734-6212-4fa0-8dff-4a91a091bdfb for instance with vm_state deleted and task_state None.
Aug 15 17:50:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-dd46f03c-8267-4670-a2bd-43bd33ad6088 tempest-TaggedAttachmentsTest-1156291487 tempest-TaggedAttachmentsTest-1156291487-project-member] Lock "2f4c50b0-1153-4b59-89d6-2192e5653827" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.517s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:32 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121817.9973698, 2f4c50b0-1153-4b59-89d6-2192e5653827 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:32 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] VM Stopped (Lifecycle Event)
Aug 15 17:50:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b2f1ad98-4c4c-4d7b-919d-d3170015feb7 None None] [instance: 2f4c50b0-1153-4b59-89d6-2192e5653827] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:36 user nova-compute[73007]: INFO nova.compute.manager [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Terminating instance
Aug 15 17:50:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-24b92aa9-d547-43a4-9a7d-48deeebd0f85 req-40be8a4e-2d4a-4871-b743-e9c5f5ace06e service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-24b92aa9-d547-43a4-9a7d-48deeebd0f85 req-40be8a4e-2d4a-4871-b743-e9c5f5ace06e service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-24b92aa9-d547-43a4-9a7d-48deeebd0f85 req-40be8a4e-2d4a-4871-b743-e9c5f5ace06e service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-24b92aa9-d547-43a4-9a7d-48deeebd0f85 req-40be8a4e-2d4a-4871-b743-e9c5f5ace06e service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-24b92aa9-d547-43a4-9a7d-48deeebd0f85 req-40be8a4e-2d4a-4871-b743-e9c5f5ace06e service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-24b92aa9-d547-43a4-9a7d-48deeebd0f85 req-40be8a4e-2d4a-4871-b743-e9c5f5ace06e service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-unplugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:50:36 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Instance destroyed successfully.
Aug 15 17:50:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lazy-loading 'resources' on Instance uuid 6b14b5d1-a493-4506-be76-029324a5aadd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1601217636',display_name='tempest-ServerStableDeviceRescueTest-server-1601217636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1601217636',id=5,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6fDWuzEVq/DVBeB7mtTRrD/fi2/SBj5rmbBPPs4B6BhnLzf8/8g05D7jlSdp2dfBdUytS4ffKyfoSx1xaRX9ixwki3Ieg4b39NYClkJRpH7USbFwcrreCMLTbEMzR+GQ==',key_name='tempest-keypair-929768774',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:47:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='097ecc4c5c86438b94fd930ca13f47dc',ramdisk_id='',reservation_id='r-yvriih0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-173917546',owner_user_name='tempest-ServerStableDeviceRescueTest-173917546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:49:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6f13824fa664d9ca209ec7b4d826bdf',uuid=6b14b5d1-a493-4506-be76-029324a5aadd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Converting VIF {"id": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "address": "fa:16:3e:13:52:73", "network": {"id": "6a895edd-4249-4372-8fe4-f76cd74491cf", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1703207131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "097ecc4c5c86438b94fd930ca13f47dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74017a60-7a", "ovs_interfaceid": "74017a60-7a29-446b-9f9d-d26f80ddbba6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:52:73,bridge_name='br-int',has_traffic_filtering=True,id=74017a60-7a29-446b-9f9d-d26f80ddbba6,network=Network(6a895edd-4249-4372-8fe4-f76cd74491cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74017a60-7a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG os_vif [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:52:73,bridge_name='br-int',has_traffic_filtering=True,id=74017a60-7a29-446b-9f9d-d26f80ddbba6,network=Network(6a895edd-4249-4372-8fe4-f76cd74491cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74017a60-7a') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74017a60-7a, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:50:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:36 user nova-compute[73007]: INFO os_vif [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:52:73,bridge_name='br-int',has_traffic_filtering=True,id=74017a60-7a29-446b-9f9d-d26f80ddbba6,network=Network(6a895edd-4249-4372-8fe4-f76cd74491cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74017a60-7a')
Aug 15 17:50:36 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Deleting instance files /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd_del
Aug 15 17:50:36 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Deletion of /opt/stack/data/nova/instances/6b14b5d1-a493-4506-be76-029324a5aadd_del complete
Aug 15 17:50:37 user nova-compute[73007]: INFO nova.compute.manager [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 17:50:37 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:50:37 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:50:37 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:50:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:38 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Took 1.48 seconds to deallocate network for instance.
Aug 15 17:50:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-4e6b85d0-5d5a-4ebb-8f68-b6786b024fe0 req-6f4249e6-664a-4bdc-be03-9e1b374b1e17 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-deleted-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:38 user nova-compute[73007]: INFO nova.compute.manager [req-4e6b85d0-5d5a-4ebb-8f68-b6786b024fe0 req-6f4249e6-664a-4bdc-be03-9e1b374b1e17 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Neutron deleted interface 74017a60-7a29-446b-9f9d-d26f80ddbba6; detaching it from the instance and deleting it from the info cache
Aug 15 17:50:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-4e6b85d0-5d5a-4ebb-8f68-b6786b024fe0 req-6f4249e6-664a-4bdc-be03-9e1b374b1e17 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-4e6b85d0-5d5a-4ebb-8f68-b6786b024fe0 req-6f4249e6-664a-4bdc-be03-9e1b374b1e17 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Detach interface failed, port_id=74017a60-7a29-446b-9f9d-d26f80ddbba6, reason: Instance 6b14b5d1-a493-4506-be76-029324a5aadd could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-879889b9-5d1d-411f-bd21-6da72a5487da req-ca3652ce-5499-4aac-8455-fb0526a0a570 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-879889b9-5d1d-411f-bd21-6da72a5487da req-ca3652ce-5499-4aac-8455-fb0526a0a570 service nova] Acquiring lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-879889b9-5d1d-411f-bd21-6da72a5487da req-ca3652ce-5499-4aac-8455-fb0526a0a570 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-879889b9-5d1d-411f-bd21-6da72a5487da req-ca3652ce-5499-4aac-8455-fb0526a0a570 service nova] Lock "6b14b5d1-a493-4506-be76-029324a5aadd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-879889b9-5d1d-411f-bd21-6da72a5487da req-ca3652ce-5499-4aac-8455-fb0526a0a570 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] No waiting events found dispatching network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:38 user nova-compute[73007]: WARNING nova.compute.manager [req-879889b9-5d1d-411f-bd21-6da72a5487da req-ca3652ce-5499-4aac-8455-fb0526a0a570 service nova] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Received unexpected event network-vif-plugged-74017a60-7a29-446b-9f9d-d26f80ddbba6 for instance with vm_state deleted and task_state None.
Aug 15 17:50:38 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:50:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:38 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Deleted allocations for instance 6b14b5d1-a493-4506-be76-029324a5aadd
Aug 15 17:50:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-33053e02-40aa-4c0a-b7ad-856bee9ddd2e tempest-ServerStableDeviceRescueTest-173917546 tempest-ServerStableDeviceRescueTest-173917546-project-member] Lock "6b14b5d1-a493-4506-be76-029324a5aadd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.851s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:50:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:50:46 user nova-compute[73007]: INFO nova.compute.claims [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Claim successful on node user
Aug 15 17:50:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:50:47 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:50:47 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Creating image(s)
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG nova.policy [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '206f089e51fd4e8f842a5584b630c736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4727295cc556413eb5dd6ca0d10f50e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk 1073741824" returned: 0 in 0.055s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-4e81d3f0-d7a4-4758-91f0-b3486da236e6 req-4f389625-d094-41ea-ad10-10555a514e8e service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-changed-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-4e81d3f0-d7a4-4758-91f0-b3486da236e6 req-4f389625-d094-41ea-ad10-10555a514e8e service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Refreshing instance network info cache due to event network-changed-89f9df72-5653-4107-9de4-9919b16b7f17. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4e81d3f0-d7a4-4758-91f0-b3486da236e6 req-4f389625-d094-41ea-ad10-10555a514e8e service nova] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4e81d3f0-d7a4-4758-91f0-b3486da236e6 req-4f389625-d094-41ea-ad10-10555a514e8e service nova] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-4e81d3f0-d7a4-4758-91f0-b3486da236e6 req-4f389625-d094-41ea-ad10-10555a514e8e service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Refreshing network info cache for port 89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Cannot resize image /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'migration_context' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Ensure instance console log exists: /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-4e81d3f0-d7a4-4758-91f0-b3486da236e6 req-4f389625-d094-41ea-ad10-10555a514e8e service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updated VIF entry in instance network info cache for port 89f9df72-5653-4107-9de4-9919b16b7f17. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:50:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-4e81d3f0-d7a4-4758-91f0-b3486da236e6 req-4f389625-d094-41ea-ad10-10555a514e8e service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4e81d3f0-d7a4-4758-91f0-b3486da236e6 req-4f389625-d094-41ea-ad10-10555a514e8e service nova] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:50:49 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Successfully created port: aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:50:50 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Successfully updated port: aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:50:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-ad558dc5-52ab-445a-99a0-de0f559d0a19 req-186e5c82-40d5-4f51-8b42-80b73d22bc42 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-changed-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-ad558dc5-52ab-445a-99a0-de0f559d0a19 req-186e5c82-40d5-4f51-8b42-80b73d22bc42 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Refreshing instance network info cache due to event network-changed-aa84c30b-91eb-44eb-8b98-b64d96aab4af. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:50:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ad558dc5-52ab-445a-99a0-de0f559d0a19 req-186e5c82-40d5-4f51-8b42-80b73d22bc42 service nova] Acquiring lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:50:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ad558dc5-52ab-445a-99a0-de0f559d0a19 req-186e5c82-40d5-4f51-8b42-80b73d22bc42 service nova] Acquired lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:50:50 user nova-compute[73007]: DEBUG nova.network.neutron [req-ad558dc5-52ab-445a-99a0-de0f559d0a19 req-186e5c82-40d5-4f51-8b42-80b73d22bc42 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Refreshing network info cache for port aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:50:50 user nova-compute[73007]: DEBUG nova.network.neutron [req-ad558dc5-52ab-445a-99a0-de0f559d0a19 req-186e5c82-40d5-4f51-8b42-80b73d22bc42 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:50:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:50:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-ad558dc5-52ab-445a-99a0-de0f559d0a19 req-186e5c82-40d5-4f51-8b42-80b73d22bc42 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ad558dc5-52ab-445a-99a0-de0f559d0a19 req-186e5c82-40d5-4f51-8b42-80b73d22bc42 service nova] Releasing lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:50:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquired lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:50:51 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:50:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:51 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:50:51 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121836.8843834, 6b14b5d1-a493-4506-be76-029324a5aadd => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:51 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] VM Stopped (Lifecycle Event)
Aug 15 17:50:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3f743ce4-ae84-48af-abc1-160b7b92827a None None] [instance: 6b14b5d1-a493-4506-be76-029324a5aadd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Releasing lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance network_info: |[{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Start _get_guest_xml network_info=[{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:50:52 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:50:52 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-232696881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-232696881',id=23,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYKKn1zc7cLwaJHycfMRCUe3YnDt3y7A79ahGepGzTkEVLNObE43i0Doaok1k/oAziNKotR0bmsCoqoc2xw31+wptNoF3yFPuYZNAyQBHnj0b2/qeCEvo1w9zDfEni0Kg==',key_name='tempest-keypair-1670192498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-rahs12xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=70146485-1eef-4e98-88d3-01f14133c3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'pci_devices' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:50:52 user nova-compute[73007]:   <uuid>70146485-1eef-4e98-88d3-01f14133c3f7</uuid>
Aug 15 17:50:52 user nova-compute[73007]:   <name>instance-00000017</name>
Aug 15 17:50:52 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:50:52 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:50:52 user nova-compute[73007]:   <metadata>
Aug 15 17:50:52 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:50:52 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:50:52 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-232696881</nova:name>
Aug 15 17:50:52 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:50:52</nova:creationTime>
Aug 15 17:50:52 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:50:52 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:50:52 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:50:52 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:50:52 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:50:52 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:50:52 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:50:52 user nova-compute[73007]:       <nova:owner>
Aug 15 17:50:52 user nova-compute[73007]:         <nova:user uuid="206f089e51fd4e8f842a5584b630c736">tempest-AttachVolumeShelveTestJSON-1726690631-project-member</nova:user>
Aug 15 17:50:52 user nova-compute[73007]:         <nova:project uuid="4727295cc556413eb5dd6ca0d10f50e7">tempest-AttachVolumeShelveTestJSON-1726690631</nova:project>
Aug 15 17:50:52 user nova-compute[73007]:       </nova:owner>
Aug 15 17:50:52 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:50:52 user nova-compute[73007]:       <nova:ports>
Aug 15 17:50:52 user nova-compute[73007]:         <nova:port uuid="aa84c30b-91eb-44eb-8b98-b64d96aab4af">
Aug 15 17:50:52 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 17:50:52 user nova-compute[73007]:         </nova:port>
Aug 15 17:50:52 user nova-compute[73007]:       </nova:ports>
Aug 15 17:50:52 user nova-compute[73007]:     </nova:instance>
Aug 15 17:50:52 user nova-compute[73007]:   </metadata>
Aug 15 17:50:52 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:50:52 user nova-compute[73007]:     <system>
Aug 15 17:50:52 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:50:52 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:50:52 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:50:52 user nova-compute[73007]:       <entry name="serial">70146485-1eef-4e98-88d3-01f14133c3f7</entry>
Aug 15 17:50:52 user nova-compute[73007]:       <entry name="uuid">70146485-1eef-4e98-88d3-01f14133c3f7</entry>
Aug 15 17:50:52 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:50:52 user nova-compute[73007]:     </system>
Aug 15 17:50:52 user nova-compute[73007]:   </sysinfo>
Aug 15 17:50:52 user nova-compute[73007]:   <os>
Aug 15 17:50:52 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:50:52 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:50:52 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:50:52 user nova-compute[73007]:   </os>
Aug 15 17:50:52 user nova-compute[73007]:   <features>
Aug 15 17:50:52 user nova-compute[73007]:     <acpi/>
Aug 15 17:50:52 user nova-compute[73007]:     <apic/>
Aug 15 17:50:52 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:50:52 user nova-compute[73007]:   </features>
Aug 15 17:50:52 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:50:52 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:50:52 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:50:52 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:50:52 user nova-compute[73007]:   </clock>
Aug 15 17:50:52 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:50:52 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:50:52 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:50:52 user nova-compute[73007]:   </cpu>
Aug 15 17:50:52 user nova-compute[73007]:   <devices>
Aug 15 17:50:52 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:50:52 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:50:52 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk"/>
Aug 15 17:50:52 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:50:52 user nova-compute[73007]:     </disk>
Aug 15 17:50:52 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:50:52 user nova-compute[73007]:       <mac address="fa:16:3e:35:27:db"/>
Aug 15 17:50:52 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:50:52 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:50:52 user nova-compute[73007]:       <target dev="tapaa84c30b-91"/>
Aug 15 17:50:52 user nova-compute[73007]:     </interface>
Aug 15 17:50:52 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:50:52 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/console.log" append="off"/>
Aug 15 17:50:52 user nova-compute[73007]:     </serial>
Aug 15 17:50:52 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:50:52 user nova-compute[73007]:     <video>
Aug 15 17:50:52 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:50:52 user nova-compute[73007]:     </video>
Aug 15 17:50:52 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:50:52 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:50:52 user nova-compute[73007]:     </rng>
Aug 15 17:50:52 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:50:52 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:50:52 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:50:52 user nova-compute[73007]:     </memballoon>
Aug 15 17:50:52 user nova-compute[73007]:   </devices>
Aug 15 17:50:52 user nova-compute[73007]: </domain>
Aug 15 17:50:52 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-232696881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-232696881',id=23,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYKKn1zc7cLwaJHycfMRCUe3YnDt3y7A79ahGepGzTkEVLNObE43i0Doaok1k/oAziNKotR0bmsCoqoc2xw31+wptNoF3yFPuYZNAyQBHnj0b2/qeCEvo1w9zDfEni0Kg==',key_name='tempest-keypair-1670192498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-rahs12xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=70146485-1eef-4e98-88d3-01f14133c3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG os_vif [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa84c30b-91, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa84c30b-91, col_values=(('external_ids', {'iface-id': 'aa84c30b-91eb-44eb-8b98-b64d96aab4af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:27:db', 'vm-uuid': '70146485-1eef-4e98-88d3-01f14133c3f7'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:52 user nova-compute[73007]: INFO os_vif [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91')
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No VIF found with MAC fa:16:3e:35:27:db, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:50:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-1cea4f73-ef36-4125-882e-f58033c86a6a req-47a4d73c-0c75-4164-8344-b2c8852b8f65 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received event network-changed-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-1cea4f73-ef36-4125-882e-f58033c86a6a req-47a4d73c-0c75-4164-8344-b2c8852b8f65 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Refreshing instance network info cache due to event network-changed-9a0ba0fd-e69d-47c4-b71b-37286881a1a3. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1cea4f73-ef36-4125-882e-f58033c86a6a req-47a4d73c-0c75-4164-8344-b2c8852b8f65 service nova] Acquiring lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1cea4f73-ef36-4125-882e-f58033c86a6a req-47a4d73c-0c75-4164-8344-b2c8852b8f65 service nova] Acquired lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG nova.network.neutron [req-1cea4f73-ef36-4125-882e-f58033c86a6a req-47a4d73c-0c75-4164-8344-b2c8852b8f65 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Refreshing network info cache for port 9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-d1f86624-6d97-4b7a-a4da-1b612af5d7dd req-0ce056e7-a1aa-4d45-9566-cf43d7a971c3 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d1f86624-6d97-4b7a-a4da-1b612af5d7dd req-0ce056e7-a1aa-4d45-9566-cf43d7a971c3 service nova] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d1f86624-6d97-4b7a-a4da-1b612af5d7dd req-0ce056e7-a1aa-4d45-9566-cf43d7a971c3 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d1f86624-6d97-4b7a-a4da-1b612af5d7dd req-0ce056e7-a1aa-4d45-9566-cf43d7a971c3 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-d1f86624-6d97-4b7a-a4da-1b612af5d7dd req-0ce056e7-a1aa-4d45-9566-cf43d7a971c3 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] No waiting events found dispatching network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:54 user nova-compute[73007]: WARNING nova.compute.manager [req-d1f86624-6d97-4b7a-a4da-1b612af5d7dd req-0ce056e7-a1aa-4d45-9566-cf43d7a971c3 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received unexpected event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af for instance with vm_state building and task_state spawning.
Aug 15 17:50:54 user nova-compute[73007]: DEBUG nova.network.neutron [req-1cea4f73-ef36-4125-882e-f58033c86a6a req-47a4d73c-0c75-4164-8344-b2c8852b8f65 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updated VIF entry in instance network info cache for port 9a0ba0fd-e69d-47c4-b71b-37286881a1a3. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG nova.network.neutron [req-1cea4f73-ef36-4125-882e-f58033c86a6a req-47a4d73c-0c75-4164-8344-b2c8852b8f65 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updating instance_info_cache with network_info: [{"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1cea4f73-ef36-4125-882e-f58033c86a6a req-47a4d73c-0c75-4164-8344-b2c8852b8f65 service nova] Releasing lock "refresh_cache-35fd679b-f098-4905-aa23-1fce430265bd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'flavor' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:55 user nova-compute[73007]: INFO nova.compute.manager [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Attaching volume 0f331d2b-8093-455f-beff-d28224a7170a to /dev/vdb
Aug 15 17:50:55 user nova-compute[73007]: DEBUG os_brick.utils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[19876829-c26b-41ef-8489-2b6d544d9545]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b6c73a-094d-4500-be57-d78e4e91e764]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eb8327-0b07-481c-b113-4e0d63849862]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[97be479e-e4fc-4cae-9201-f041fe2a4eaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:50:55 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bafa77-fd1f-4df9-8e5b-d33763b78808]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG os_brick.utils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updating existing volume attachment record: 6ccee0fe-95a4-41cb-b361-0323851eb8da {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "accaba3e-7f1d-4638-8338-453f429a0c40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "accaba3e-7f1d-4638-8338-453f429a0c40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:55 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:50:55 user nova-compute[73007]: INFO nova.compute.claims [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Claim successful on node user
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121856.0351737, 70146485-1eef-4e98-88d3-01f14133c3f7 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] VM Resumed (Lifecycle Event)
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance spawned successfully.
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121856.0369062, 70146485-1eef-4e98-88d3-01f14133c3f7 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] VM Started (Lifecycle Event)
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Took 8.71 seconds to spawn the instance on the hypervisor.
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-f3808ebf-133c-4638-bfc7-f6fcfefff69d req-49714fec-e79a-44ce-a218-38f7c160ca64 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3808ebf-133c-4638-bfc7-f6fcfefff69d req-49714fec-e79a-44ce-a218-38f7c160ca64 service nova] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3808ebf-133c-4638-bfc7-f6fcfefff69d req-49714fec-e79a-44ce-a218-38f7c160ca64 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3808ebf-133c-4638-bfc7-f6fcfefff69d req-49714fec-e79a-44ce-a218-38f7c160ca64 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-f3808ebf-133c-4638-bfc7-f6fcfefff69d req-49714fec-e79a-44ce-a218-38f7c160ca64 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] No waiting events found dispatching network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:50:56 user nova-compute[73007]: WARNING nova.compute.manager [req-f3808ebf-133c-4638-bfc7-f6fcfefff69d req-49714fec-e79a-44ce-a218-38f7c160ca64 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received unexpected event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af for instance with vm_state building and task_state spawning.
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.compute.manager [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Took 9.60 seconds to build instance.
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4693556d-03b4-4a58-be2a-06560346e716 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.699s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.policy [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52391420381427297cc8c55600112b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba0a5fb91043d9a46323b202cd924c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:50:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Creating image(s)
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "/opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "/opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "/opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.218s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk 1073741824" returned: 0 in 0.057s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Successfully created port: 06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Cannot resize image /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'migration_context' on Instance uuid accaba3e-7f1d-4638-8338-453f429a0c40 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Ensure instance console log exists: /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:50:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Successfully updated port: 06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquired lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-c4d3f8c8-b1fc-4a20-b66c-2d4fc484752e req-a20935d5-93c9-4954-84cd-b03815a0cbd4 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-changed-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-c4d3f8c8-b1fc-4a20-b66c-2d4fc484752e req-a20935d5-93c9-4954-84cd-b03815a0cbd4 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Refreshing instance network info cache due to event network-changed-06d8a570-8b59-44eb-874e-55022131b039. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c4d3f8c8-b1fc-4a20-b66c-2d4fc484752e req-a20935d5-93c9-4954-84cd-b03815a0cbd4 service nova] Acquiring lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Releasing lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Instance network_info: |[{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c4d3f8c8-b1fc-4a20-b66c-2d4fc484752e req-a20935d5-93c9-4954-84cd-b03815a0cbd4 service nova] Acquired lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.neutron [req-c4d3f8c8-b1fc-4a20-b66c-2d4fc484752e req-a20935d5-93c9-4954-84cd-b03815a0cbd4 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Refreshing network info cache for port 06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Start _get_guest_xml network_info=[{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:50:58 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:50:58 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1834821300',display_name='tempest-ServerActionsTestOtherA-server-1834821300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1834821300',id=24,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-mwnkt1dr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=accaba3e-7f1d-4638-8338-453f429a0c40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:6e:9a,bridge_name='br-int',has_traffic_filtering=True,id=06d8a570-8b59-44eb-874e-55022131b039,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06d8a570-8b') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'pci_devices' on Instance uuid accaba3e-7f1d-4638-8338-453f429a0c40 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:50:58 user nova-compute[73007]:   <uuid>accaba3e-7f1d-4638-8338-453f429a0c40</uuid>
Aug 15 17:50:58 user nova-compute[73007]:   <name>instance-00000018</name>
Aug 15 17:50:58 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:50:58 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:50:58 user nova-compute[73007]:   <metadata>
Aug 15 17:50:58 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:50:58 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:50:58 user nova-compute[73007]:       <nova:name>tempest-ServerActionsTestOtherA-server-1834821300</nova:name>
Aug 15 17:50:58 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:50:58</nova:creationTime>
Aug 15 17:50:58 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:50:58 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:50:58 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:50:58 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:50:58 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:50:58 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:50:58 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:50:58 user nova-compute[73007]:       <nova:owner>
Aug 15 17:50:58 user nova-compute[73007]:         <nova:user uuid="d52391420381427297cc8c55600112b0">tempest-ServerActionsTestOtherA-226008880-project-member</nova:user>
Aug 15 17:50:58 user nova-compute[73007]:         <nova:project uuid="09ba0a5fb91043d9a46323b202cd924c">tempest-ServerActionsTestOtherA-226008880</nova:project>
Aug 15 17:50:58 user nova-compute[73007]:       </nova:owner>
Aug 15 17:50:58 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:50:58 user nova-compute[73007]:       <nova:ports>
Aug 15 17:50:58 user nova-compute[73007]:         <nova:port uuid="06d8a570-8b59-44eb-874e-55022131b039">
Aug 15 17:50:58 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 17:50:58 user nova-compute[73007]:         </nova:port>
Aug 15 17:50:58 user nova-compute[73007]:       </nova:ports>
Aug 15 17:50:58 user nova-compute[73007]:     </nova:instance>
Aug 15 17:50:58 user nova-compute[73007]:   </metadata>
Aug 15 17:50:58 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:50:58 user nova-compute[73007]:     <system>
Aug 15 17:50:58 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:50:58 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:50:58 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:50:58 user nova-compute[73007]:       <entry name="serial">accaba3e-7f1d-4638-8338-453f429a0c40</entry>
Aug 15 17:50:58 user nova-compute[73007]:       <entry name="uuid">accaba3e-7f1d-4638-8338-453f429a0c40</entry>
Aug 15 17:50:58 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:50:58 user nova-compute[73007]:     </system>
Aug 15 17:50:58 user nova-compute[73007]:   </sysinfo>
Aug 15 17:50:58 user nova-compute[73007]:   <os>
Aug 15 17:50:58 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:50:58 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:50:58 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:50:58 user nova-compute[73007]:   </os>
Aug 15 17:50:58 user nova-compute[73007]:   <features>
Aug 15 17:50:58 user nova-compute[73007]:     <acpi/>
Aug 15 17:50:58 user nova-compute[73007]:     <apic/>
Aug 15 17:50:58 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:50:58 user nova-compute[73007]:   </features>
Aug 15 17:50:58 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:50:58 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:50:58 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:50:58 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:50:58 user nova-compute[73007]:   </clock>
Aug 15 17:50:58 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:50:58 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:50:58 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:50:58 user nova-compute[73007]:   </cpu>
Aug 15 17:50:58 user nova-compute[73007]:   <devices>
Aug 15 17:50:58 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:50:58 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:50:58 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk"/>
Aug 15 17:50:58 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:50:58 user nova-compute[73007]:     </disk>
Aug 15 17:50:58 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:50:58 user nova-compute[73007]:       <mac address="fa:16:3e:22:6e:9a"/>
Aug 15 17:50:58 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:50:58 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:50:58 user nova-compute[73007]:       <target dev="tap06d8a570-8b"/>
Aug 15 17:50:58 user nova-compute[73007]:     </interface>
Aug 15 17:50:58 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:50:58 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/console.log" append="off"/>
Aug 15 17:50:58 user nova-compute[73007]:     </serial>
Aug 15 17:50:58 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:50:58 user nova-compute[73007]:     <video>
Aug 15 17:50:58 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:50:58 user nova-compute[73007]:     </video>
Aug 15 17:50:58 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:50:58 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:50:58 user nova-compute[73007]:     </rng>
Aug 15 17:50:58 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:50:58 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:50:58 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:50:58 user nova-compute[73007]:     </memballoon>
Aug 15 17:50:58 user nova-compute[73007]:   </devices>
Aug 15 17:50:58 user nova-compute[73007]: </domain>
Aug 15 17:50:58 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1834821300',display_name='tempest-ServerActionsTestOtherA-server-1834821300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1834821300',id=24,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-mwnkt1dr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=accaba3e-7f1d-4638-8338-453f429a0c40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:6e:9a,bridge_name='br-int',has_traffic_filtering=True,id=06d8a570-8b59-44eb-874e-55022131b039,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06d8a570-8b') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG os_vif [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:6e:9a,bridge_name='br-int',has_traffic_filtering=True,id=06d8a570-8b59-44eb-874e-55022131b039,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06d8a570-8b') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06d8a570-8b, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06d8a570-8b, col_values=(('external_ids', {'iface-id': '06d8a570-8b59-44eb-874e-55022131b039', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:6e:9a', 'vm-uuid': 'accaba3e-7f1d-4638-8338-453f429a0c40'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:58 user nova-compute[73007]: INFO os_vif [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:6e:9a,bridge_name='br-int',has_traffic_filtering=True,id=06d8a570-8b59-44eb-874e-55022131b039,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06d8a570-8b')
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No VIF found with MAC fa:16:3e:22:6e:9a, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.neutron [req-c4d3f8c8-b1fc-4a20-b66c-2d4fc484752e req-a20935d5-93c9-4954-84cd-b03815a0cbd4 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updated VIF entry in instance network info cache for port 06d8a570-8b59-44eb-874e-55022131b039. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG nova.network.neutron [req-c4d3f8c8-b1fc-4a20-b66c-2d4fc484752e req-a20935d5-93c9-4954-84cd-b03815a0cbd4 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:50:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c4d3f8c8-b1fc-4a20-b66c-2d4fc484752e req-a20935d5-93c9-4954-84cd-b03815a0cbd4 service nova] Releasing lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:50:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:50:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-be35c3a4-8a88-4ac0-a15b-984549f4125c req-0da968e0-8877-4861-a07a-0644b0e54ca0 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-be35c3a4-8a88-4ac0-a15b-984549f4125c req-0da968e0-8877-4861-a07a-0644b0e54ca0 service nova] Acquiring lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-be35c3a4-8a88-4ac0-a15b-984549f4125c req-0da968e0-8877-4861-a07a-0644b0e54ca0 service nova] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-be35c3a4-8a88-4ac0-a15b-984549f4125c req-0da968e0-8877-4861-a07a-0644b0e54ca0 service nova] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-be35c3a4-8a88-4ac0-a15b-984549f4125c req-0da968e0-8877-4861-a07a-0644b0e54ca0 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] No waiting events found dispatching network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:00 user nova-compute[73007]: WARNING nova.compute.manager [req-be35c3a4-8a88-4ac0-a15b-984549f4125c req-0da968e0-8877-4861-a07a-0644b0e54ca0 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received unexpected event network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 for instance with vm_state building and task_state spawning.
Aug 15 17:51:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG nova.objects.instance [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'flavor' on Instance uuid 384f0339-eed5-4573-90fb-1dd91c4cce90 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:01 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Ignoring supplied device name: /dev/vdb
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:01 user nova-compute[73007]: INFO nova.compute.manager [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Attaching volume 1842d339-2b94-4492-8817-641e96b29efd to /dev/vdb
Aug 15 17:51:01 user nova-compute[73007]: DEBUG os_brick.utils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ba9e2e-ce36-44cc-b74c-be6c4e3bbb31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1410f81a-9dea-4bff-b7a3-7750f9c4f12f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[051dcde2-a97f-467d-9acd-e65e0aa29732]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f2e79-6177-41d1-b839-99e0b0e0f485]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:51:02 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ba42f0-fdbd-426d-86e1-6103bfe15215]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG os_brick.utils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Updating existing volume attachment record: b28a0ddb-7e8a-4b0f-9f2e-cb7c3cf8d824 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121862.1547253, accaba3e-7f1d-4638-8338-453f429a0c40 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:51:02 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] VM Resumed (Lifecycle Event)
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:51:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Instance spawned successfully.
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:02 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121862.1640182, accaba3e-7f1d-4638-8338-453f429a0c40 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:51:02 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] VM Started (Lifecycle Event)
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:51:02 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:51:02 user nova-compute[73007]: INFO nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:02 user nova-compute[73007]: INFO nova.compute.manager [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Took 6.74 seconds to build instance.
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] Acquiring lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] No waiting events found dispatching network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:02 user nova-compute[73007]: WARNING nova.compute.manager [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received unexpected event network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 for instance with vm_state active and task_state None.
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received event network-changed-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Refreshing instance network info cache due to event network-changed-54801e94-e676-4e15-9cb8-236b5c6dc420. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] Acquiring lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] Acquired lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG nova.network.neutron [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Refreshing network info cache for port 54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a14f4063-6bd9-47d7-830e-53d444842158 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "accaba3e-7f1d-4638-8338-453f429a0c40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.865s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Updated VIF entry in instance network info cache for port 54801e94-e676-4e15-9cb8-236b5c6dc420. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:51:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Updating instance_info_cache with network_info: [{"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e80afe0-c0a4-4f5b-95bb-6859690e5563 req-411a2e01-be66-4822-af3f-c2931591b1ab service nova] Releasing lock "refresh_cache-384f0339-eed5-4573-90fb-1dd91c4cce90" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:51:07 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:51:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquired lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'info_cache' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Releasing lock "refresh_cache-42c38120-5e1d-4438-a53b-8a188e417c91" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance destroyed successfully.
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'resources' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_vif [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c926c8a-89, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:51:12 user nova-compute[73007]: INFO os_vif [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89')
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Start _get_guest_xml network_info=[{"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'numa_topology' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:12 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:12 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'pci_devices' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:51:12 user nova-compute[73007]:   <uuid>42c38120-5e1d-4438-a53b-8a188e417c91</uuid>
Aug 15 17:51:12 user nova-compute[73007]:   <name>instance-00000004</name>
Aug 15 17:51:12 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:51:12 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:51:12 user nova-compute[73007]:   <metadata>
Aug 15 17:51:12 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:51:12 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:51:12 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeTestJSON-server-1553936509</nova:name>
Aug 15 17:51:12 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:51:12</nova:creationTime>
Aug 15 17:51:12 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:51:12 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:51:12 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:51:12 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:51:12 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:51:12 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:51:12 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:51:12 user nova-compute[73007]:       <nova:owner>
Aug 15 17:51:12 user nova-compute[73007]:         <nova:user uuid="1395246c93fc4c0dac8d95fffefd9711">tempest-AttachVolumeTestJSON-1742996205-project-member</nova:user>
Aug 15 17:51:12 user nova-compute[73007]:         <nova:project uuid="e1deb9da1fb54f8b8968f01265347c48">tempest-AttachVolumeTestJSON-1742996205</nova:project>
Aug 15 17:51:12 user nova-compute[73007]:       </nova:owner>
Aug 15 17:51:12 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:51:12 user nova-compute[73007]:       <nova:ports>
Aug 15 17:51:12 user nova-compute[73007]:         <nova:port uuid="2c926c8a-890e-40cf-b2c4-906f890e4791">
Aug 15 17:51:12 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 17:51:12 user nova-compute[73007]:         </nova:port>
Aug 15 17:51:12 user nova-compute[73007]:       </nova:ports>
Aug 15 17:51:12 user nova-compute[73007]:     </nova:instance>
Aug 15 17:51:12 user nova-compute[73007]:   </metadata>
Aug 15 17:51:12 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:51:12 user nova-compute[73007]:     <system>
Aug 15 17:51:12 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:51:12 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:51:12 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:51:12 user nova-compute[73007]:       <entry name="serial">42c38120-5e1d-4438-a53b-8a188e417c91</entry>
Aug 15 17:51:12 user nova-compute[73007]:       <entry name="uuid">42c38120-5e1d-4438-a53b-8a188e417c91</entry>
Aug 15 17:51:12 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:51:12 user nova-compute[73007]:     </system>
Aug 15 17:51:12 user nova-compute[73007]:   </sysinfo>
Aug 15 17:51:12 user nova-compute[73007]:   <os>
Aug 15 17:51:12 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:51:12 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:51:12 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:51:12 user nova-compute[73007]:   </os>
Aug 15 17:51:12 user nova-compute[73007]:   <features>
Aug 15 17:51:12 user nova-compute[73007]:     <acpi/>
Aug 15 17:51:12 user nova-compute[73007]:     <apic/>
Aug 15 17:51:12 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:51:12 user nova-compute[73007]:   </features>
Aug 15 17:51:12 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:51:12 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:51:12 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:51:12 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:51:12 user nova-compute[73007]:   </clock>
Aug 15 17:51:12 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:51:12 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:51:12 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:51:12 user nova-compute[73007]:   </cpu>
Aug 15 17:51:12 user nova-compute[73007]:   <devices>
Aug 15 17:51:12 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:51:12 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:51:12 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk"/>
Aug 15 17:51:12 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:51:12 user nova-compute[73007]:     </disk>
Aug 15 17:51:12 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:51:12 user nova-compute[73007]:       <mac address="fa:16:3e:4c:f4:0a"/>
Aug 15 17:51:12 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:51:12 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:51:12 user nova-compute[73007]:       <target dev="tap2c926c8a-89"/>
Aug 15 17:51:12 user nova-compute[73007]:     </interface>
Aug 15 17:51:12 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:51:12 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/console.log" append="off"/>
Aug 15 17:51:12 user nova-compute[73007]:     </serial>
Aug 15 17:51:12 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:51:12 user nova-compute[73007]:     <video>
Aug 15 17:51:12 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:51:12 user nova-compute[73007]:     </video>
Aug 15 17:51:12 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:51:12 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:51:12 user nova-compute[73007]:     </rng>
Aug 15 17:51:12 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:51:12 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:51:12 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:51:12 user nova-compute[73007]:     </memballoon>
Aug 15 17:51:12 user nova-compute[73007]:   </devices>
Aug 15 17:51:12 user nova-compute[73007]: </domain>
Aug 15 17:51:12 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUlWhRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:12 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[15802925-4420-43fe-911a-17bdc4d03352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:51:12 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqSLmBzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c551f9-e679-49d2-bba2-94a2ec08f39a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd] added
Aug 15 17:51:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[05536486-1c87-437c-865c-61a6b0e847d8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a3e224-118f-46f4-8ce9-fd8c3d293025]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjUlWhRT {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjUlWhRT" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d3b651-cb6f-4b70-b532-cfedf1018543]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjUlWhRT'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf293c72-541b-479d-a08a-8da623ceaa1b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[22153a09-812d-4172-a2cd-128b653201c0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:51:12 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 17:51:12 user nova-compute[73007]:  {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 17:51:12 user nova-compute[73007]: 
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8fccbe-fc51-40a2-868e-f200fdee561b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd, portal: 172.16.0.220,3260]
Aug 15 17:51:12 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd, portal: 172.16.0.220,3260] successful.
Aug 15 17:51:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9e0094-3039-4444-a234-687abd2cc314]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[85306d9b-8538-4e8f-a370-d40975ce16f6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[803060c8-6d57-4d14-afd6-32821c43dbde]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.267s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Cannot resize image /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG nova.objects.instance [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'migration_context' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG os_vif [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c926c8a-89, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c926c8a-89, col_values=(('external_ids', {'iface-id': '2c926c8a-890e-40cf-b2c4-906f890e4791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:f4:0a', 'vm-uuid': '42c38120-5e1d-4438-a53b-8a188e417c91'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:13 user nova-compute[73007]: INFO os_vif [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89')
Aug 15 17:51:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121877.1833491, 42c38120-5e1d-4438-a53b-8a188e417c91 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:51:17 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Resumed (Lifecycle Event)
Aug 15 17:51:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUlWhRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 5.289s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] <== connect_volume: return (5293ms) {'type': 'block', 'scsi_wwn': '23062356261353739', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062356261353739', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-8f85ccda-f095-4f0a-82f1-defae47a29ca req-ca9e4e4c-1c65-4e86-bc76-5fbb2fba68b6 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f85ccda-f095-4f0a-82f1-defae47a29ca req-ca9e4e4c-1c65-4e86-bc76-5fbb2fba68b6 service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f85ccda-f095-4f0a-82f1-defae47a29ca req-ca9e4e4c-1c65-4e86-bc76-5fbb2fba68b6 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f85ccda-f095-4f0a-82f1-defae47a29ca req-ca9e4e4c-1c65-4e86-bc76-5fbb2fba68b6 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-8f85ccda-f095-4f0a-82f1-defae47a29ca req-ca9e4e4c-1c65-4e86-bc76-5fbb2fba68b6 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:17 user nova-compute[73007]: WARNING nova.compute.manager [req-8f85ccda-f095-4f0a-82f1-defae47a29ca req-ca9e4e4c-1c65-4e86-bc76-5fbb2fba68b6 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state stopped and task_state powering-on.
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-acc1ea6c-6d6c-4d64-abbb-6a25670ec06c req-0a51bef3-b2dc-4f40-a5de-8a769d9ff077 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-acc1ea6c-6d6c-4d64-abbb-6a25670ec06c req-0a51bef3-b2dc-4f40-a5de-8a769d9ff077 service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-acc1ea6c-6d6c-4d64-abbb-6a25670ec06c req-0a51bef3-b2dc-4f40-a5de-8a769d9ff077 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-acc1ea6c-6d6c-4d64-abbb-6a25670ec06c req-0a51bef3-b2dc-4f40-a5de-8a769d9ff077 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-acc1ea6c-6d6c-4d64-abbb-6a25670ec06c req-0a51bef3-b2dc-4f40-a5de-8a769d9ff077 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:17 user nova-compute[73007]: WARNING nova.compute.manager [req-acc1ea6c-6d6c-4d64-abbb-6a25670ec06c req-0a51bef3-b2dc-4f40-a5de-8a769d9ff077 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state stopped and task_state powering-on.
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.262s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:17 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:17 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bc05dd-b129-4bec-a490-8e2f354a3517]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:51:17 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance rebooted successfully.
Aug 15 17:51:17 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:17 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7376MB free_disk=25.500926971435547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-482aa7f0-9a5f-4f4a-87a0-709b833f27a4 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.objects.instance [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'flavor' on Instance uuid 384f0339-eed5-4573-90fb-1dd91c4cce90 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad766bd-f0ed-4f90-9eac-65456d9ac4e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a] added
Aug 15 17:51:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121877.1841056, 42c38120-5e1d-4438-a53b-8a188e417c91 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:51:17 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Started (Lifecycle Event)
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4689647e-54e6-43a9-b09d-335a1de7163c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:51:17 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:51:17 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:51:17 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:51:17 user nova-compute[73007]:   <serial>1842d339-2b94-4492-8817-641e96b29efd</serial>
Aug 15 17:51:17 user nova-compute[73007]: </disk>
Aug 15 17:51:17 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[19604954-e3f5-462b-ad21-d978beee0123]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqSLmBzh {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yqSLmBzh" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d858ee80-6301-445b-9308-573573c9b267]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yqSLmBzh'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[840a4b18-a9a6-4336-a355-e3787c13401c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c73c102-686b-46aa-b509-7bb28848ac9a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 35fd679b-f098-4905-aa23-1fce430265bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 384f0339-eed5-4573-90fb-1dd91c4cce90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 99297e55-b8a9-4b15-9afe-724a494228a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 70146485-1eef-4e98-88d3-01f14133c3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acdb1c4-073e-4e18-996f-e5d09e41a1d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a, portal: 172.16.0.220,3260]
Aug 15 17:51:17 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a, portal: 172.16.0.220,3260] successful.
Aug 15 17:51:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 81fc8cd9-5759-4d17-9ff5-6e1c249d376f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4524089c-2112-41be-b70d-27e4b01f4a49]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a00b54-b46a-4478-97c7-21d3a9dc6b34]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:17 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:17 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:51:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4fa21e-d675-4065-9406-2a86e779fddb]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqSLmBzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] No VIF found with MAC fa:16:3e:a3:d2:ae, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.606s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:51:18 user nova-compute[73007]: INFO nova.compute.claims [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Claim successful on node user
Aug 15 17:51:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d90c8399-a8f6-4166-9517-75152bb7082c tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.807s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] <== connect_volume: return (6636ms) {'type': 'block', 'scsi_wwn': '23666306631336165', 'path': '/dev/sdc'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666306631336165', 'path': '/dev/sdc'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'flavor' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:51:19 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:51:19 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 17:51:19 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:51:19 user nova-compute[73007]:   <serial>0f331d2b-8093-455f-beff-d28224a7170a</serial>
Aug 15 17:51:19 user nova-compute[73007]: </disk>
Aug 15 17:51:19 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:51:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.policy [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cd910b3e8bf406f8512b3470f6eaca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eebca3ef0a45788b0dfbc03b01fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:51:19 user nova-compute[73007]: INFO nova.virt.block_device [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Booting with volume snapshot 24b22b0d-bd54-4ee9-9836-2036f3af0950 at /dev/vda
Aug 15 17:51:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No VIF found with MAC fa:16:3e:8c:cb:95, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:51:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bcc66a70-6862-46f8-9cf9-cc064c4b1a4f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.694s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:20 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Successfully created port: c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Successfully updated port: c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "refresh_cache-81fc8cd9-5759-4d17-9ff5-6e1c249d376f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquired lock "refresh_cache-81fc8cd9-5759-4d17-9ff5-6e1c249d376f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-1d080aeb-34c8-4359-8997-ac8e53b5ca6d req-0b91ac8c-325b-41d1-932e-5557143e982c service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-changed-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-1d080aeb-34c8-4359-8997-ac8e53b5ca6d req-0b91ac8c-325b-41d1-932e-5557143e982c service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Refreshing instance network info cache due to event network-changed-c818c292-4339-41d2-8455-a57a05f49e89. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1d080aeb-34c8-4359-8997-ac8e53b5ca6d req-0b91ac8c-325b-41d1-932e-5557143e982c service nova] Acquiring lock "refresh_cache-81fc8cd9-5759-4d17-9ff5-6e1c249d376f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Updating instance_info_cache with network_info: [{"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Releasing lock "refresh_cache-81fc8cd9-5759-4d17-9ff5-6e1c249d376f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Instance network_info: |[{"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1d080aeb-34c8-4359-8997-ac8e53b5ca6d req-0b91ac8c-325b-41d1-932e-5557143e982c service nova] Acquired lock "refresh_cache-81fc8cd9-5759-4d17-9ff5-6e1c249d376f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:21 user nova-compute[73007]: DEBUG nova.network.neutron [req-1d080aeb-34c8-4359-8997-ac8e53b5ca6d req-0b91ac8c-325b-41d1-932e-5557143e982c service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Refreshing network info cache for port c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:51:22 user nova-compute[73007]: DEBUG nova.network.neutron [req-1d080aeb-34c8-4359-8997-ac8e53b5ca6d req-0b91ac8c-325b-41d1-932e-5557143e982c service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Updated VIF entry in instance network info cache for port c818c292-4339-41d2-8455-a57a05f49e89. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:51:22 user nova-compute[73007]: DEBUG nova.network.neutron [req-1d080aeb-34c8-4359-8997-ac8e53b5ca6d req-0b91ac8c-325b-41d1-932e-5557143e982c service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Updating instance_info_cache with network_info: [{"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1d080aeb-34c8-4359-8997-ac8e53b5ca6d req-0b91ac8c-325b-41d1-932e-5557143e982c service nova] Releasing lock "refresh_cache-81fc8cd9-5759-4d17-9ff5-6e1c249d376f" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:23 user nova-compute[73007]: DEBUG nova.objects.instance [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'flavor' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:24 user nova-compute[73007]: INFO nova.compute.manager [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Attaching volume 2de49a07-046f-45aa-8bfb-d01bf99083bb to /dev/vdc
Aug 15 17:51:24 user nova-compute[73007]: DEBUG os_brick.utils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4086c806-f82a-498c-a74f-0df771a5b381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c3f8d6-d64b-4af2-8d47-8e9c3f768e58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[041a25c6-687a-466c-92db-2cf9ffd14db1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34400fd-b239-43b2-9ca0-c52b239aa101]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:51:24 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea498336-a4cb-43e1-aa59-bcf5952d784b]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG os_brick.utils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updating existing volume attachment record: 381db7cb-970f-4b81-a942-daec590dd21e {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:24 user nova-compute[73007]: INFO nova.compute.manager [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] instance snapshotting
Aug 15 17:51:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Beginning live snapshot process
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json -f qcow2 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json -f qcow2" returned: 0 in 0.248s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json -f qcow2 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG os_brick.utils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57f9d95-7e29-40f7-adf0-3efdede1a9b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f13c0d-ec8b-46dc-af50-0f1bac6d2042]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc22f50-d23c-4b13-977d-c9602eae2da9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json -f qcow2" returned: 0 in 0.303s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1397ec31-9c80-47d6-bbe3-095707e2e23e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:51:25 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa2e5d-4b64-463b-90d7-8df350ab1ac5]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG os_brick.utils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Updating existing volume attachment record: 7c899645-659e-4f7f-9153-011a91895d5f {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmglox6uv/97514bb7a8c24a22bf6789ba04926feb.delta 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmglox6uv/97514bb7a8c24a22bf6789ba04926feb.delta 1073741824" returned: 0 in 0.052s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:25 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 17:51:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:51:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 17:51:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 17:51:26 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:51:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmglox6uv/97514bb7a8c24a22bf6789ba04926feb.delta /opt/stack/data/nova/instances/snapshots/tmpmglox6uv/97514bb7a8c24a22bf6789ba04926feb {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmglox6uv/97514bb7a8c24a22bf6789ba04926feb.delta /opt/stack/data/nova/instances/snapshots/tmpmglox6uv/97514bb7a8c24a22bf6789ba04926feb" returned: 0 in 0.961s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:27 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Snapshot extracted, beginning image upload
Aug 15 17:51:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Snapshot image upload complete
Aug 15 17:51:31 user nova-compute[73007]: INFO nova.compute.manager [None req-bb97a218-4a70-474b-b0ef-7b9dfca5b137 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Took 6.51 seconds to snapshot the instance on the hypervisor.
Aug 15 17:51:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:51:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Creating image(s)
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Ensure instance console log exists: /opt/stack/data/nova/instances/81fc8cd9-5759-4d17-9ff5-6e1c249d376f/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Start _get_guest_xml network_info=[{"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMEkvCfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81fc8cd9-5759-4d17-9ff5-6e1c249d376f', 'attached_at': '', 'detached_at': '', 'volume_id': '69b565a9-aa3b-4930-b306-a66bb7cdd83d', 'serial': '69b565a9-aa3b-4930-b306-a66bb7cdd83d'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '7c899645-659e-4f7f-9153-011a91895d5f', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:51:35 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:35 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMEkvCfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:35 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:35 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:35 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2a64fe-d270-40de-9f27-e37bf4f6f1e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:51:35 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d3a744-1df8-4204-b527-f18b71af57b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d] added
Aug 15 17:51:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[562fe9b4-86d7-47e8-89ab-3237e7571b9e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed6ba72-979d-4b7e-a11a-5102e97e60d4]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMEkvCfg {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMEkvCfg" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2fbd15-3f7a-4d3f-a9e2-a726119a8ed7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cMEkvCfg'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1607824b-7f3d-4e4a-b141-abc822a43eb7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a02155-6d9d-40d1-adf1-9905d927669f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:36 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:36 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd2210c-583d-477a-82ad-8d8b1c37c35a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d, portal: 172.16.0.220,3260]
Aug 15 17:51:36 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d, portal: 172.16.0.220,3260] successful.
Aug 15 17:51:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9147f7-f13f-4bb2-9b14-22069d3fd309]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e6995-2f89-4d74-b962-888d6730f96b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:36 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:36 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:36 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:36 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:36 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8befe03c-14a3-4d13-b680-4d3f72a8fcb7]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:36 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMEkvCfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26261313636656133', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261313636656133', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1851150820',display_name='tempest-TestVolumeBootPattern-server-1851150820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1851150820',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-xcovy1e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:51:19Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=81fc8cd9-5759-4d17-9ff5-6e1c249d376f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ff:f0,bridge_name='br-int',has_traffic_filtering=True,id=c818c292-4339-41d2-8455-a57a05f49e89,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc818c292-43') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.objects.instance [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'pci_devices' on Instance uuid 81fc8cd9-5759-4d17-9ff5-6e1c249d376f {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:51:37 user nova-compute[73007]:   <uuid>81fc8cd9-5759-4d17-9ff5-6e1c249d376f</uuid>
Aug 15 17:51:37 user nova-compute[73007]:   <name>instance-00000019</name>
Aug 15 17:51:37 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:51:37 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:51:37 user nova-compute[73007]:   <metadata>
Aug 15 17:51:37 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:51:37 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:51:37 user nova-compute[73007]:       <nova:name>tempest-TestVolumeBootPattern-server-1851150820</nova:name>
Aug 15 17:51:37 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:51:35</nova:creationTime>
Aug 15 17:51:37 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:51:37 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:51:37 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:51:37 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:51:37 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:51:37 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:51:37 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:51:37 user nova-compute[73007]:       <nova:owner>
Aug 15 17:51:37 user nova-compute[73007]:         <nova:user uuid="4cd910b3e8bf406f8512b3470f6eaca5">tempest-TestVolumeBootPattern-393609756-project-member</nova:user>
Aug 15 17:51:37 user nova-compute[73007]:         <nova:project uuid="c6eebca3ef0a45788b0dfbc03b01fe8c">tempest-TestVolumeBootPattern-393609756</nova:project>
Aug 15 17:51:37 user nova-compute[73007]:       </nova:owner>
Aug 15 17:51:37 user nova-compute[73007]:       <nova:ports>
Aug 15 17:51:37 user nova-compute[73007]:         <nova:port uuid="c818c292-4339-41d2-8455-a57a05f49e89">
Aug 15 17:51:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 17:51:37 user nova-compute[73007]:         </nova:port>
Aug 15 17:51:37 user nova-compute[73007]:       </nova:ports>
Aug 15 17:51:37 user nova-compute[73007]:     </nova:instance>
Aug 15 17:51:37 user nova-compute[73007]:   </metadata>
Aug 15 17:51:37 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:51:37 user nova-compute[73007]:     <system>
Aug 15 17:51:37 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:51:37 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:51:37 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:51:37 user nova-compute[73007]:       <entry name="serial">81fc8cd9-5759-4d17-9ff5-6e1c249d376f</entry>
Aug 15 17:51:37 user nova-compute[73007]:       <entry name="uuid">81fc8cd9-5759-4d17-9ff5-6e1c249d376f</entry>
Aug 15 17:51:37 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:51:37 user nova-compute[73007]:     </system>
Aug 15 17:51:37 user nova-compute[73007]:   </sysinfo>
Aug 15 17:51:37 user nova-compute[73007]:   <os>
Aug 15 17:51:37 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:51:37 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:51:37 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:51:37 user nova-compute[73007]:   </os>
Aug 15 17:51:37 user nova-compute[73007]:   <features>
Aug 15 17:51:37 user nova-compute[73007]:     <acpi/>
Aug 15 17:51:37 user nova-compute[73007]:     <apic/>
Aug 15 17:51:37 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:51:37 user nova-compute[73007]:   </features>
Aug 15 17:51:37 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:51:37 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:51:37 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:51:37 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:51:37 user nova-compute[73007]:   </clock>
Aug 15 17:51:37 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:51:37 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:51:37 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:51:37 user nova-compute[73007]:   </cpu>
Aug 15 17:51:37 user nova-compute[73007]:   <devices>
Aug 15 17:51:37 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:51:37 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:51:37 user nova-compute[73007]:       <source dev="/dev/sdd"/>
Aug 15 17:51:37 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:51:37 user nova-compute[73007]:       <serial>69b565a9-aa3b-4930-b306-a66bb7cdd83d</serial>
Aug 15 17:51:37 user nova-compute[73007]:     </disk>
Aug 15 17:51:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:51:37 user nova-compute[73007]:       <mac address="fa:16:3e:bc:ff:f0"/>
Aug 15 17:51:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:51:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:51:37 user nova-compute[73007]:       <target dev="tapc818c292-43"/>
Aug 15 17:51:37 user nova-compute[73007]:     </interface>
Aug 15 17:51:37 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:51:37 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/81fc8cd9-5759-4d17-9ff5-6e1c249d376f/console.log" append="off"/>
Aug 15 17:51:37 user nova-compute[73007]:     </serial>
Aug 15 17:51:37 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:51:37 user nova-compute[73007]:     <video>
Aug 15 17:51:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:51:37 user nova-compute[73007]:     </video>
Aug 15 17:51:37 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:51:37 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:51:37 user nova-compute[73007]:     </rng>
Aug 15 17:51:37 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:51:37 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:51:37 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:51:37 user nova-compute[73007]:     </memballoon>
Aug 15 17:51:37 user nova-compute[73007]:   </devices>
Aug 15 17:51:37 user nova-compute[73007]: </domain>
Aug 15 17:51:37 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1851150820',display_name='tempest-TestVolumeBootPattern-server-1851150820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1851150820',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-xcovy1e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:51:19Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=81fc8cd9-5759-4d17-9ff5-6e1c249d376f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ff:f0,bridge_name='br-int',has_traffic_filtering=True,id=c818c292-4339-41d2-8455-a57a05f49e89,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc818c292-43') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG os_vif [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ff:f0,bridge_name='br-int',has_traffic_filtering=True,id=c818c292-4339-41d2-8455-a57a05f49e89,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc818c292-43') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc818c292-43, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc818c292-43, col_values=(('external_ids', {'iface-id': 'c818c292-4339-41d2-8455-a57a05f49e89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:ff:f0', 'vm-uuid': '81fc8cd9-5759-4d17-9ff5-6e1c249d376f'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:37 user nova-compute[73007]: INFO os_vif [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ff:f0,bridge_name='br-int',has_traffic_filtering=True,id=c818c292-4339-41d2-8455-a57a05f49e89,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc818c292-43')
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No VIF found with MAC fa:16:3e:bc:ff:f0, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:51:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RByheYpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:40 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:40 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:40 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ae6cc-8664-4ec3-a352-73eeb82b432c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:51:40 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0be4ad-4457-43cd-b5fc-ee914addacb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb] added
Aug 15 17:51:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d1f743-c450-4bb3-99e1-cc417402f8ab]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-5053345c-378e-4bd7-8458-47cfaf5155db req-6b569376-cd28-4e7b-add0-7ac52280e54f service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5053345c-378e-4bd7-8458-47cfaf5155db req-6b569376-cd28-4e7b-add0-7ac52280e54f service nova] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5053345c-378e-4bd7-8458-47cfaf5155db req-6b569376-cd28-4e7b-add0-7ac52280e54f service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5053345c-378e-4bd7-8458-47cfaf5155db req-6b569376-cd28-4e7b-add0-7ac52280e54f service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-5053345c-378e-4bd7-8458-47cfaf5155db req-6b569376-cd28-4e7b-add0-7ac52280e54f service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] No waiting events found dispatching network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:40 user nova-compute[73007]: WARNING nova.compute.manager [req-5053345c-378e-4bd7-8458-47cfaf5155db req-6b569376-cd28-4e7b-add0-7ac52280e54f service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received unexpected event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 for instance with vm_state building and task_state spawning.
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f1cc6f-ca3a-4b3b-b5dc-d38bd4fa060f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RByheYpm {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RByheYpm" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8d8d9c-39d4-4ae0-a14d-9da994e38e30]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RByheYpm'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b440df-10f0-4935-83f5-896decfe3260]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[583beed5-e47e-4926-87fb-ea6fd0f83475]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c7b36-ce9d-47b6-bc5e-80492a80fdce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb, portal: 172.16.0.220,3260]
Aug 15 17:51:40 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb, portal: 172.16.0.220,3260] successful.
Aug 15 17:51:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca91b162-9699-463a-af7a-ab9e143cca24]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad4d661-4b30-489c-b57d-bff3a8b9b7d4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb (non-flash)
Aug 15 17:51:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:40 user nova-compute[73007]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb (non-flash)
Aug 15 17:51:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4629fe44-b6a0-4f80-bf1a-eb8b10d72006]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:51:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RByheYpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121901.1843605, 81fc8cd9-5759-4d17-9ff5-6e1c249d376f => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:51:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] VM Resumed (Lifecycle Event)
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:51:41 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Instance spawned successfully.
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:51:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121901.1852093, 81fc8cd9-5759-4d17-9ff5-6e1c249d376f => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:51:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] VM Started (Lifecycle Event)
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:51:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:51:41 user nova-compute[73007]: INFO nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:41 user nova-compute[73007]: INFO nova.compute.manager [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Took 23.61 seconds to build instance.
Aug 15 17:51:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a653d3-bb5b-48b5-b3ac-eba742683cc2 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.768s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23961363435373935', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961363435373935', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:51:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'flavor' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:51:42 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:51:42 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:51:42 user nova-compute[73007]:   <target dev="vdc" bus="virtio"/>
Aug 15 17:51:42 user nova-compute[73007]:   <serial>2de49a07-046f-45aa-8bfb-d01bf99083bb</serial>
Aug 15 17:51:42 user nova-compute[73007]: </disk>
Aug 15 17:51:42 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] No VIF found with MAC fa:16:3e:8c:cb:95, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-826e7f25-9d2d-41f0-be06-d82e2deaf897 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.629s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-19bddf5c-fbf8-4ae4-b37b-cacce01236e6 req-7dd9b646-a6b7-43e2-a347-14e3fe72ba78 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-19bddf5c-fbf8-4ae4-b37b-cacce01236e6 req-7dd9b646-a6b7-43e2-a347-14e3fe72ba78 service nova] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-19bddf5c-fbf8-4ae4-b37b-cacce01236e6 req-7dd9b646-a6b7-43e2-a347-14e3fe72ba78 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-19bddf5c-fbf8-4ae4-b37b-cacce01236e6 req-7dd9b646-a6b7-43e2-a347-14e3fe72ba78 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-19bddf5c-fbf8-4ae4-b37b-cacce01236e6 req-7dd9b646-a6b7-43e2-a347-14e3fe72ba78 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] No waiting events found dispatching network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:42 user nova-compute[73007]: WARNING nova.compute.manager [req-19bddf5c-fbf8-4ae4-b37b-cacce01236e6 req-7dd9b646-a6b7-43e2-a347-14e3fe72ba78 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received unexpected event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 for instance with vm_state active and task_state None.
Aug 15 17:51:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "99297e55-b8a9-4b15-9afe-724a494228a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "99297e55-b8a9-4b15-9afe-724a494228a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:43 user nova-compute[73007]: INFO nova.compute.manager [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Terminating instance
Aug 15 17:51:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:51:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:44 user nova-compute[73007]: INFO nova.compute.manager [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Detaching volume 2de49a07-046f-45aa-8bfb-d01bf99083bb
Aug 15 17:51:44 user nova-compute[73007]: INFO nova.virt.block_device [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Attempting to driver detach volume 2de49a07-046f-45aa-8bfb-d01bf99083bb from mountpoint /dev/vdc
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Attempting to detach device vdc from instance 35fd679b-f098-4905-aa23-1fce430265bd from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:51:44 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:51:44 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:51:44 user nova-compute[73007]:   <target dev="vdc" bus="virtio"/>
Aug 15 17:51:44 user nova-compute[73007]:   <serial>2de49a07-046f-45aa-8bfb-d01bf99083bb</serial>
Aug 15 17:51:44 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 17:51:44 user nova-compute[73007]: </disk>
Aug 15 17:51:44 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:51:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Successfully detached device vdc from instance 35fd679b-f098-4905-aa23-1fce430265bd from the persistent domain config.
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 35fd679b-f098-4905-aa23-1fce430265bd from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:51:44 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:51:44 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:51:44 user nova-compute[73007]:   <target dev="vdc" bus="virtio"/>
Aug 15 17:51:44 user nova-compute[73007]:   <serial>2de49a07-046f-45aa-8bfb-d01bf99083bb</serial>
Aug 15 17:51:44 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 17:51:44 user nova-compute[73007]: </disk>
Aug 15 17:51:44 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Instance destroyed successfully.
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lazy-loading 'resources' on Instance uuid 99297e55-b8a9-4b15-9afe-724a494228a6 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-507384064',display_name='tempest-ServersNegativeTestJSON-server-507384064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-507384064',id=21,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:50:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b56c9a439844149abcefe8703cdc906',ramdisk_id='',reservation_id='r-z9lj0x0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1246805643',owner_user_name='tempest-ServersNegativeTestJSON-1246805643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:50:01Z,user_data=None,user_id='f02af903ce234948b57be7978398f8e8',uuid=99297e55-b8a9-4b15-9afe-724a494228a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converting VIF {"id": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "address": "fa:16:3e:85:5f:a1", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d07fe9f-b0", "ovs_interfaceid": "7d07fe9f-b079-4022-8b38-0bccc81c1045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:5f:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d07fe9f-b079-4022-8b38-0bccc81c1045,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d07fe9f-b0') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG os_vif [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:5f:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d07fe9f-b079-4022-8b38-0bccc81c1045,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d07fe9f-b0') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d07fe9f-b0, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:44 user nova-compute[73007]: INFO os_vif [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:5f:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d07fe9f-b079-4022-8b38-0bccc81c1045,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d07fe9f-b0')
Aug 15 17:51:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Deleting instance files /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6_del
Aug 15 17:51:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Deletion of /opt/stack/data/nova/instances/99297e55-b8a9-4b15-9afe-724a494228a6_del complete
Aug 15 17:51:44 user nova-compute[73007]: INFO nova.compute.manager [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received event network-vif-unplugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] Acquiring lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] No waiting events found dispatching network-vif-unplugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received event network-vif-unplugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received event network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] Acquiring lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] Lock "99297e55-b8a9-4b15-9afe-724a494228a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] No waiting events found dispatching network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:44 user nova-compute[73007]: WARNING nova.compute.manager [req-9fee8ca2-4267-4e6c-854c-c0f1f0914969 req-4a38e842-7503-43c8-9f84-a05af2cc477c service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received unexpected event network-vif-plugged-7d07fe9f-b079-4022-8b38-0bccc81c1045 for instance with vm_state active and task_state deleting.
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121904.9192095, 35fd679b-f098-4905-aa23-1fce430265bd => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:51:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Successfully detached device vdc from instance 35fd679b-f098-4905-aa23-1fce430265bd from the live domain config.
Aug 15 17:51:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RByheYpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:44 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d25ee-6d89-43bb-92f7-0d5a1de65e43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cbe2f9-dade-471e-868b-8abc7ef5831f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:45 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:45 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:45 user nova-compute[73007]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb (non-flash)
Aug 15 17:51:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:45 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:45 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:45 user nova-compute[73007]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb (non-flash)
Aug 15 17:51:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11505da5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cc7f24-af1d-49fa-a085-253b3edf8a13]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0acc4c-3242-45d9-80e6-aa24fa45ef64]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce29076-b48c-4ca4-93ec-55618eea497f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6995dc4f-67e2-4ad6-a314-307bc7467c46]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b04ef9b-cf1c-4702-b3dd-eae29ece563b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79f98e4-2ea0-47a8-a84a-51ab99ae9f93]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb, portal: 172.16.0.220,3260]
Aug 15 17:51:45 user nova-compute[73007]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb, portal: 172.16.0.220,3260] successful.
Aug 15 17:51:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2de49a07-046f-45aa-8bfb-d01bf99083bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f6cd0-fbe1-4ef9-9a7e-f78117dffef2]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] <== disconnect_volume: return (404ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-27ddfe39-9b63-42c2-afb0-e1abf725c76c req-3ce2b3d6-e958-43e2-80b3-16c59083c964 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Received event network-vif-deleted-7d07fe9f-b079-4022-8b38-0bccc81c1045 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:45 user nova-compute[73007]: INFO nova.compute.manager [req-27ddfe39-9b63-42c2-afb0-e1abf725c76c req-3ce2b3d6-e958-43e2-80b3-16c59083c964 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Neutron deleted interface 7d07fe9f-b079-4022-8b38-0bccc81c1045; detaching it from the instance and deleting it from the info cache
Aug 15 17:51:45 user nova-compute[73007]: DEBUG nova.network.neutron [req-27ddfe39-9b63-42c2-afb0-e1abf725c76c req-3ce2b3d6-e958-43e2-80b3-16c59083c964 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:45 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Took 0.68 seconds to deallocate network for instance.
Aug 15 17:51:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-27ddfe39-9b63-42c2-afb0-e1abf725c76c req-3ce2b3d6-e958-43e2-80b3-16c59083c964 service nova] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Detach interface failed, port_id=7d07fe9f-b079-4022-8b38-0bccc81c1045, reason: Instance 99297e55-b8a9-4b15-9afe-724a494228a6 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:51:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:45 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Deleted allocations for instance 99297e55-b8a9-4b15-9afe-724a494228a6
Aug 15 17:51:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2d08452e-0221-4876-b77f-5ae447d8a885 tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "99297e55-b8a9-4b15-9afe-724a494228a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.400s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:46 user nova-compute[73007]: DEBUG nova.objects.instance [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'flavor' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e5958257-0083-4ea4-a83c-0e5b1ce8d74d tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.266s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:51:48 user nova-compute[73007]: INFO nova.compute.claims [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Claim successful on node user
Aug 15 17:51:48 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:51:49 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:51:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:51:49 user nova-compute[73007]: INFO nova.virt.block_device [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Booting with volume 8e090ef5-d29e-43bf-8295-960b3b25b00b at /dev/vda
Aug 15 17:51:49 user nova-compute[73007]: DEBUG nova.policy [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8de582a0433c424c8f7f76d74b9abe09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee8ba5df700457f9f97355fd864bece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG os_brick.utils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6684eec-2289-4740-b9fe-deed4e418080]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a5ad72-077c-484d-8ac1-ef3d2b088406]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c12d74-ba91-4fa5-ae5e-2e5907e4fe02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb336bc5-2a78-4a43-8db9-16433a5f79df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:51:49 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:51:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8972ba-c91c-494f-a0db-21d5d4e1ca78]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG os_brick.utils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updating existing volume attachment record: d36c9de7-7177-4efa-88c7-03f59cb8c85f {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:49 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Successfully created port: e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:51:50 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Successfully updated port: e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:51:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquired lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:50 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:51:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-f5687aa7-2792-40f5-a91f-c46172fef9c3 req-6f3f348d-6704-43c8-ad3b-a7af3ff8aba8 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-changed-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-f5687aa7-2792-40f5-a91f-c46172fef9c3 req-6f3f348d-6704-43c8-ad3b-a7af3ff8aba8 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Refreshing instance network info cache due to event network-changed-e8a4549a-52c9-4091-a515-2515a704233a. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:51:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f5687aa7-2792-40f5-a91f-c46172fef9c3 req-6f3f348d-6704-43c8-ad3b-a7af3ff8aba8 service nova] Acquiring lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updating instance_info_cache with network_info: [{"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Releasing lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance network_info: |[{"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f5687aa7-2792-40f5-a91f-c46172fef9c3 req-6f3f348d-6704-43c8-ad3b-a7af3ff8aba8 service nova] Acquired lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-f5687aa7-2792-40f5-a91f-c46172fef9c3 req-6f3f348d-6704-43c8-ad3b-a7af3ff8aba8 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Refreshing network info cache for port e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-f5687aa7-2792-40f5-a91f-c46172fef9c3 req-6f3f348d-6704-43c8-ad3b-a7af3ff8aba8 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updated VIF entry in instance network info cache for port e8a4549a-52c9-4091-a515-2515a704233a. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-f5687aa7-2792-40f5-a91f-c46172fef9c3 req-6f3f348d-6704-43c8-ad3b-a7af3ff8aba8 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updating instance_info_cache with network_info: [{"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f5687aa7-2792-40f5-a91f-c46172fef9c3 req-6f3f348d-6704-43c8-ad3b-a7af3ff8aba8 service nova] Releasing lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:53 user nova-compute[73007]: INFO nova.compute.manager [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Detaching volume 1842d339-2b94-4492-8817-641e96b29efd
Aug 15 17:51:53 user nova-compute[73007]: INFO nova.virt.block_device [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Attempting to driver detach volume 1842d339-2b94-4492-8817-641e96b29efd from mountpoint /dev/vdb
Aug 15 17:51:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Attempting to detach device vdb from instance 384f0339-eed5-4573-90fb-1dd91c4cce90 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:51:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:51:53 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:51:53 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:51:53 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:51:53 user nova-compute[73007]:   <serial>1842d339-2b94-4492-8817-641e96b29efd</serial>
Aug 15 17:51:53 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:51:53 user nova-compute[73007]: </disk>
Aug 15 17:51:53 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:51:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:53 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Successfully detached device vdb from instance 384f0339-eed5-4573-90fb-1dd91c4cce90 from the persistent domain config.
Aug 15 17:51:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 384f0339-eed5-4573-90fb-1dd91c4cce90 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:51:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:51:53 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:51:53 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:51:53 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:51:53 user nova-compute[73007]:   <serial>1842d339-2b94-4492-8817-641e96b29efd</serial>
Aug 15 17:51:53 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:51:53 user nova-compute[73007]: </disk>
Aug 15 17:51:53 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121914.3115957, 384f0339-eed5-4573-90fb-1dd91c4cce90 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 384f0339-eed5-4573-90fb-1dd91c4cce90 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:51:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Successfully detached device vdb from instance 384f0339-eed5-4573-90fb-1dd91c4cce90 from the live domain config.
Aug 15 17:51:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUlWhRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:54 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea03fda-1cf3-4f87-9e3f-cc2856d743db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36875bf-c978-438b-b446-21eccb820198]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:54 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:54 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd (non-flash)
Aug 15 17:51:54 user nova-compute[73007]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:54 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11507cd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70780f7-6c02-47a9-b2fd-c7724c3f2635]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b58209-ddac-4f7e-af44-f8ce189a53b4]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5a33b8-031c-4b50-9588-83bf8540bc0d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f285dd-7252-493b-a679-c31e843a6fcd]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[be320837-5a4f-4f20-9105-c471acb9fd48]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68a2290-5478-423a-902e-5eaa984eadaf]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd, portal: 172.16.0.220,3260]
Aug 15 17:51:54 user nova-compute[73007]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd, portal: 172.16.0.220,3260] successful.
Aug 15 17:51:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fedf9e-bfed-4253-94be-5db2196b9901]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] <== disconnect_volume: return (277ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:51:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'flavor' on Instance uuid 384f0339-eed5-4573-90fb-1dd91c4cce90 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a6b2b65-8b0a-4089-89dd-394af002b0c0 tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.800s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.666s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:55 user nova-compute[73007]: INFO nova.compute.manager [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Terminating instance
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:51:55 user nova-compute[73007]: INFO nova.compute.claims [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Claim successful on node user
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-58125147-e70d-4692-8b3a-78ec77945d62 req-500d32a8-d7b9-4804-a12c-ca3926f7f012 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received event network-changed-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-58125147-e70d-4692-8b3a-78ec77945d62 req-500d32a8-d7b9-4804-a12c-ca3926f7f012 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Refreshing instance network info cache due to event network-changed-6510aa47-8337-470f-bf79-62a651835537. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-58125147-e70d-4692-8b3a-78ec77945d62 req-500d32a8-d7b9-4804-a12c-ca3926f7f012 service nova] Acquiring lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-58125147-e70d-4692-8b3a-78ec77945d62 req-500d32a8-d7b9-4804-a12c-ca3926f7f012 service nova] Acquired lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.network.neutron [req-58125147-e70d-4692-8b3a-78ec77945d62 req-500d32a8-d7b9-4804-a12c-ca3926f7f012 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Refreshing network info cache for port 6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-8cf43fcb-0be0-41c8-b9c8-f0e1e9518424 req-b075554b-2785-47c1-92ac-e082e96e3292 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received event network-vif-unplugged-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8cf43fcb-0be0-41c8-b9c8-f0e1e9518424 req-b075554b-2785-47c1-92ac-e082e96e3292 service nova] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8cf43fcb-0be0-41c8-b9c8-f0e1e9518424 req-b075554b-2785-47c1-92ac-e082e96e3292 service nova] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8cf43fcb-0be0-41c8-b9c8-f0e1e9518424 req-b075554b-2785-47c1-92ac-e082e96e3292 service nova] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-8cf43fcb-0be0-41c8-b9c8-f0e1e9518424 req-b075554b-2785-47c1-92ac-e082e96e3292 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] No waiting events found dispatching network-vif-unplugged-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-8cf43fcb-0be0-41c8-b9c8-f0e1e9518424 req-b075554b-2785-47c1-92ac-e082e96e3292 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received event network-vif-unplugged-54801e94-e676-4e15-9cb8-236b5c6dc420 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:51:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Instance destroyed successfully.
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.objects.instance [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lazy-loading 'resources' on Instance uuid 384f0339-eed5-4573-90fb-1dd91c4cce90 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1234601535',display_name='tempest-VolumesSnapshotTestJSON-instance-1234601535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1234601535',id=19,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIgUbv7mld3AK9lMKUePfrGAOz86mtlmI1hS3su1oXd2wZe/unhzEf7s7+7R5Ep3BoKy6NW9thXaeCxzw+udgblO7slAFF8p6vZShbFeqGaHh/a28p5uLW2B3tEdqgI4A==',key_name='tempest-keypair-492944954',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dac3717304e944b3b364bc599eb8e0bc',ramdisk_id='',reservation_id='r-8uibw994',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1500133320',owner_user_name='tempest-VolumesSnapshotTestJSON-1500133320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b107f48a8a614494a0431c38e37f79f6',uuid=384f0339-eed5-4573-90fb-1dd91c4cce90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converting VIF {"id": "54801e94-e676-4e15-9cb8-236b5c6dc420", "address": "fa:16:3e:a3:d2:ae", "network": {"id": "5ef28fba-2d02-4b87-b9e5-db45dd25b143", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692592559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dac3717304e944b3b364bc599eb8e0bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54801e94-e6", "ovs_interfaceid": "54801e94-e676-4e15-9cb8-236b5c6dc420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=54801e94-e676-4e15-9cb8-236b5c6dc420,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54801e94-e6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_vif [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=54801e94-e676-4e15-9cb8-236b5c6dc420,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54801e94-e6') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54801e94-e6, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:56 user nova-compute[73007]: INFO os_vif [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:d2:ae,bridge_name='br-int',has_traffic_filtering=True,id=54801e94-e676-4e15-9cb8-236b5c6dc420,network=Network(5ef28fba-2d02-4b87-b9e5-db45dd25b143),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54801e94-e6')
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjUlWhRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:56 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1842d339-2b94-4492-8817-641e96b29efd', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3107d9a7-1c65-4886-a970-a22fd8e94edb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a94054-e6b8-4b15-8a9f-3f4717b783d5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:56 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:56 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:56 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:56 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c64ae60>, {}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Disconnecting from: [] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] <== disconnect_volume: return (98ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:51:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Deleting instance files /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90_del
Aug 15 17:51:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Deletion of /opt/stack/data/nova/instances/384f0339-eed5-4573-90fb-1dd91c4cce90_del complete
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:51:56 user nova-compute[73007]: INFO nova.compute.manager [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.network.neutron [req-58125147-e70d-4692-8b3a-78ec77945d62 req-500d32a8-d7b9-4804-a12c-ca3926f7f012 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Updated VIF entry in instance network info cache for port 6510aa47-8337-470f-bf79-62a651835537. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.network.neutron [req-58125147-e70d-4692-8b3a-78ec77945d62 req-500d32a8-d7b9-4804-a12c-ca3926f7f012 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Updating instance_info_cache with network_info: [{"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-58125147-e70d-4692-8b3a-78ec77945d62 req-500d32a8-d7b9-4804-a12c-ca3926f7f012 service nova] Releasing lock "refresh_cache-eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.policy [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f886ee6939504c4b9a406cedb9a65acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94edb7a50c4e0e97ddc96c5c0028fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:51:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Creating image(s)
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:51:57 user nova-compute[73007]: INFO nova.compute.claims [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Claim successful on node user
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk 1073741824" returned: 0 in 0.048s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.177s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Cannot resize image /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'migration_context' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Ensure instance console log exists: /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.network.neutron [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:57 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:51:57 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Took 1.14 seconds to deallocate network for instance.
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.compute.manager [req-2614081b-5b34-4446-8b3c-4301a94e5461 req-aa958bdd-0f4d-4b89-bfd6-3234661bbfd8 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received event network-vif-deleted-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:57 user nova-compute[73007]: INFO nova.compute.manager [req-2614081b-5b34-4446-8b3c-4301a94e5461 req-aa958bdd-0f4d-4b89-bfd6-3234661bbfd8 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Neutron deleted interface 54801e94-e676-4e15-9cb8-236b5c6dc420; detaching it from the instance and deleting it from the info cache
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.network.neutron [req-2614081b-5b34-4446-8b3c-4301a94e5461 req-aa958bdd-0f4d-4b89-bfd6-3234661bbfd8 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:57 user nova-compute[73007]: WARNING nova.volume.cinder [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Attachment b28a0ddb-7e8a-4b0f-9f2e-cb7c3cf8d824 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b28a0ddb-7e8a-4b0f-9f2e-cb7c3cf8d824. (HTTP 404) (Request-ID: req-0bb3fed4-5113-404b-8629-df3984731cf0)
Aug 15 17:51:57 user nova-compute[73007]: INFO nova.compute.manager [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.compute.manager [req-2614081b-5b34-4446-8b3c-4301a94e5461 req-aa958bdd-0f4d-4b89-bfd6-3234661bbfd8 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Detach interface failed, port_id=54801e94-e676-4e15-9cb8-236b5c6dc420, reason: Instance 384f0339-eed5-4573-90fb-1dd91c4cce90 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.policy [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f886ee6939504c4b9a406cedb9a65acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94edb7a50c4e0e97ddc96c5c0028fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:51:57 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Creating image(s)
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:57 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Successfully created port: 9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-b4dad687-75c7-4a06-a84f-fe46ae2aa686 req-7af473af-cd9a-4029-b90d-ba355782d160 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received event network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4dad687-75c7-4a06-a84f-fe46ae2aa686 req-7af473af-cd9a-4029-b90d-ba355782d160 service nova] Acquiring lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4dad687-75c7-4a06-a84f-fe46ae2aa686 req-7af473af-cd9a-4029-b90d-ba355782d160 service nova] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b4dad687-75c7-4a06-a84f-fe46ae2aa686 req-7af473af-cd9a-4029-b90d-ba355782d160 service nova] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-b4dad687-75c7-4a06-a84f-fe46ae2aa686 req-7af473af-cd9a-4029-b90d-ba355782d160 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] No waiting events found dispatching network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:51:58 user nova-compute[73007]: WARNING nova.compute.manager [req-b4dad687-75c7-4a06-a84f-fe46ae2aa686 req-7af473af-cd9a-4029-b90d-ba355782d160 service nova] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Received unexpected event network-vif-plugged-54801e94-e676-4e15-9cb8-236b5c6dc420 for instance with vm_state deleted and task_state None.
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.209s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk 1073741824" returned: 0 in 0.063s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.681s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:58 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Deleted allocations for instance 384f0339-eed5-4573-90fb-1dd91c4cce90
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5bd593cf-d4bb-40d0-a1aa-6589399811ce tempest-VolumesSnapshotTestJSON-1500133320 tempest-VolumesSnapshotTestJSON-1500133320-project-member] Lock "384f0339-eed5-4573-90fb-1dd91c4cce90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Cannot resize image /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.objects.instance [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'migration_context' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Ensure instance console log exists: /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Successfully updated port: 9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquired lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:51:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updating instance_info_cache with network_info: [{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Successfully created port: d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Releasing lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance network_info: |[{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Start _get_guest_xml network_info=[{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:51:59 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:59 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1941915722',display_name='tempest-ServerRescueNegativeTestJSON-server-1941915722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1941915722',id=27,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-daik9wph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:51:57Z,user_data=None,user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=b8628c95-e352-41e4-b7d5-af0aa9ebcb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=9fec5233-53d4-4263-abd5-dd4e68a94c53,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec5233-53') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'pci_devices' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:51:59 user nova-compute[73007]:   <uuid>b8628c95-e352-41e4-b7d5-af0aa9ebcb0c</uuid>
Aug 15 17:51:59 user nova-compute[73007]:   <name>instance-0000001b</name>
Aug 15 17:51:59 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:51:59 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:51:59 user nova-compute[73007]:   <metadata>
Aug 15 17:51:59 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:51:59 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:51:59 user nova-compute[73007]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1941915722</nova:name>
Aug 15 17:51:59 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:51:59</nova:creationTime>
Aug 15 17:51:59 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:51:59 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:51:59 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:51:59 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:51:59 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:51:59 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:51:59 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:51:59 user nova-compute[73007]:       <nova:owner>
Aug 15 17:51:59 user nova-compute[73007]:         <nova:user uuid="f886ee6939504c4b9a406cedb9a65acc">tempest-ServerRescueNegativeTestJSON-1846740548-project-member</nova:user>
Aug 15 17:51:59 user nova-compute[73007]:         <nova:project uuid="8f94edb7a50c4e0e97ddc96c5c0028fc">tempest-ServerRescueNegativeTestJSON-1846740548</nova:project>
Aug 15 17:51:59 user nova-compute[73007]:       </nova:owner>
Aug 15 17:51:59 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:51:59 user nova-compute[73007]:       <nova:ports>
Aug 15 17:51:59 user nova-compute[73007]:         <nova:port uuid="9fec5233-53d4-4263-abd5-dd4e68a94c53">
Aug 15 17:51:59 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 17:51:59 user nova-compute[73007]:         </nova:port>
Aug 15 17:51:59 user nova-compute[73007]:       </nova:ports>
Aug 15 17:51:59 user nova-compute[73007]:     </nova:instance>
Aug 15 17:51:59 user nova-compute[73007]:   </metadata>
Aug 15 17:51:59 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:51:59 user nova-compute[73007]:     <system>
Aug 15 17:51:59 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:51:59 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:51:59 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:51:59 user nova-compute[73007]:       <entry name="serial">b8628c95-e352-41e4-b7d5-af0aa9ebcb0c</entry>
Aug 15 17:51:59 user nova-compute[73007]:       <entry name="uuid">b8628c95-e352-41e4-b7d5-af0aa9ebcb0c</entry>
Aug 15 17:51:59 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:51:59 user nova-compute[73007]:     </system>
Aug 15 17:51:59 user nova-compute[73007]:   </sysinfo>
Aug 15 17:51:59 user nova-compute[73007]:   <os>
Aug 15 17:51:59 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:51:59 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:51:59 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:51:59 user nova-compute[73007]:   </os>
Aug 15 17:51:59 user nova-compute[73007]:   <features>
Aug 15 17:51:59 user nova-compute[73007]:     <acpi/>
Aug 15 17:51:59 user nova-compute[73007]:     <apic/>
Aug 15 17:51:59 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:51:59 user nova-compute[73007]:   </features>
Aug 15 17:51:59 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:51:59 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:51:59 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:51:59 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:51:59 user nova-compute[73007]:   </clock>
Aug 15 17:51:59 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:51:59 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:51:59 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:51:59 user nova-compute[73007]:   </cpu>
Aug 15 17:51:59 user nova-compute[73007]:   <devices>
Aug 15 17:51:59 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:51:59 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:51:59 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk"/>
Aug 15 17:51:59 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:51:59 user nova-compute[73007]:     </disk>
Aug 15 17:51:59 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:51:59 user nova-compute[73007]:       <mac address="fa:16:3e:b7:f2:a6"/>
Aug 15 17:51:59 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:51:59 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:51:59 user nova-compute[73007]:       <target dev="tap9fec5233-53"/>
Aug 15 17:51:59 user nova-compute[73007]:     </interface>
Aug 15 17:51:59 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:51:59 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/console.log" append="off"/>
Aug 15 17:51:59 user nova-compute[73007]:     </serial>
Aug 15 17:51:59 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:51:59 user nova-compute[73007]:     <video>
Aug 15 17:51:59 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:51:59 user nova-compute[73007]:     </video>
Aug 15 17:51:59 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:51:59 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:51:59 user nova-compute[73007]:     </rng>
Aug 15 17:51:59 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:51:59 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:51:59 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:51:59 user nova-compute[73007]:     </memballoon>
Aug 15 17:51:59 user nova-compute[73007]:   </devices>
Aug 15 17:51:59 user nova-compute[73007]: </domain>
Aug 15 17:51:59 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1941915722',display_name='tempest-ServerRescueNegativeTestJSON-server-1941915722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1941915722',id=27,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-daik9wph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:51:57Z,user_data=None,user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=b8628c95-e352-41e4-b7d5-af0aa9ebcb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=9fec5233-53d4-4263-abd5-dd4e68a94c53,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec5233-53') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_vif [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=9fec5233-53d4-4263-abd5-dd4e68a94c53,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec5233-53') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fec5233-53, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fec5233-53, col_values=(('external_ids', {'iface-id': '9fec5233-53d4-4263-abd5-dd4e68a94c53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:f2:a6', 'vm-uuid': 'b8628c95-e352-41e4-b7d5-af0aa9ebcb0c'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:51:59 user nova-compute[73007]: INFO os_vif [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=9fec5233-53d4-4263-abd5-dd4e68a94c53,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec5233-53')
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121904.5473614, 99297e55-b8a9-4b15-9afe-724a494228a6 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:51:59 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] VM Stopped (Lifecycle Event)
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.compute.manager [None req-bbfebbc4-1305-4f49-a5b4-e1f3fe3ee8fa None None] [instance: 99297e55-b8a9-4b15-9afe-724a494228a6] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No VIF found with MAC fa:16:3e:b7:f2:a6, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:51:59 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Creating image(s)
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Ensure instance console log exists: /opt/stack/data/nova/instances/e6bc8143-ca4e-40cb-a38d-0a1caec7eb61/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Start _get_guest_xml network_info=[{"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6bc8143-ca4e-40cb-a38d-0a1caec7eb61', 'attached_at': '', 'detached_at': '', 'volume_id': '8e090ef5-d29e-43bf-8295-960b3b25b00b', 'serial': '8e090ef5-d29e-43bf-8295-960b3b25b00b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd36c9de7-7177-4efa-88c7-03f59cb8c85f', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:51:59 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:59 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:51:59 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:59 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:51:59 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73407123-6565-4a2b-add1-f427e5020f53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:51:59 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[71331a8d-ff5e-4a72-8240-1d18e2c8607e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b] added
Aug 15 17:51:59 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ae8e3f-1d8b-473e-b5d8-6e21d6927ad5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bdca84-64fb-4457-a4ae-0cbf5a30c013]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMeNEvxZ {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMeNEvxZ" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e777b-fc36-402e-b15c-99d274006cd5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMeNEvxZ'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0a5ca8-e106-4eca-9ebf-0db2bc392e05]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03312b3-69a0-4dc3-a59d-107f24086ae7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:59 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:59 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:51:59 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:51:59 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a414d1-3710-4993-8c7b-6ddab4fa0e22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260]
Aug 15 17:51:59 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260] successful.
Aug 15 17:51:59 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc62b0f-2ca1-4b9c-8e95-7ebb0088bc87]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:51:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7827ab0-1bfd-4299-9d87-c74903fdd2e0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:00 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:00 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:00 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:00 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abf6d0e-eb87-4475-8297-3d43c01eeebe]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ca6e2674-3f24-4a24-8324-7e9064d1d712 req-1c943bc5-91b9-43b2-a9b5-2ea5e8bc573b service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-changed-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ca6e2674-3f24-4a24-8324-7e9064d1d712 req-1c943bc5-91b9-43b2-a9b5-2ea5e8bc573b service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Refreshing instance network info cache due to event network-changed-9fec5233-53d4-4263-abd5-dd4e68a94c53. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ca6e2674-3f24-4a24-8324-7e9064d1d712 req-1c943bc5-91b9-43b2-a9b5-2ea5e8bc573b service nova] Acquiring lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ca6e2674-3f24-4a24-8324-7e9064d1d712 req-1c943bc5-91b9-43b2-a9b5-2ea5e8bc573b service nova] Acquired lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.neutron [req-ca6e2674-3f24-4a24-8324-7e9064d1d712 req-1c943bc5-91b9-43b2-a9b5-2ea5e8bc573b service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Refreshing network info cache for port 9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Successfully updated port: d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquired lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-cc4cf8ca-39d0-4948-9fd5-aaeb4a5a19de req-f9891c59-b478-455a-8507-9dbc9cd97381 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-changed-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-cc4cf8ca-39d0-4948-9fd5-aaeb4a5a19de req-f9891c59-b478-455a-8507-9dbc9cd97381 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Refreshing instance network info cache due to event network-changed-d0452311-67f5-4735-b13c-a468d4b75e2d. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cc4cf8ca-39d0-4948-9fd5-aaeb4a5a19de req-f9891c59-b478-455a-8507-9dbc9cd97381 service nova] Acquiring lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.neutron [req-ca6e2674-3f24-4a24-8324-7e9064d1d712 req-1c943bc5-91b9-43b2-a9b5-2ea5e8bc573b service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updated VIF entry in instance network info cache for port 9fec5233-53d4-4263-abd5-dd4e68a94c53. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.neutron [req-ca6e2674-3f24-4a24-8324-7e9064d1d712 req-1c943bc5-91b9-43b2-a9b5-2ea5e8bc573b service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updating instance_info_cache with network_info: [{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ca6e2674-3f24-4a24-8324-7e9064d1d712 req-1c943bc5-91b9-43b2-a9b5-2ea5e8bc573b service nova] Releasing lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Updating instance_info_cache with network_info: [{"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Releasing lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Instance network_info: |[{"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cc4cf8ca-39d0-4948-9fd5-aaeb4a5a19de req-f9891c59-b478-455a-8507-9dbc9cd97381 service nova] Acquired lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.neutron [req-cc4cf8ca-39d0-4948-9fd5-aaeb4a5a19de req-f9891c59-b478-455a-8507-9dbc9cd97381 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Refreshing network info cache for port d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Start _get_guest_xml network_info=[{"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:52:00 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:52:00 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1509921233',display_name='tempest-ServerRescueNegativeTestJSON-server-1509921233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1509921233',id=28,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-nsttvj8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:51:58Z,user_data=None,user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=d9648621-6b91-4028-9f89-83302bc7a8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:ce:c8,bridge_name='br-int',has_traffic_filtering=True,id=d0452311-67f5-4735-b13c-a468d4b75e2d,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0452311-67') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.objects.instance [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'pci_devices' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:52:00 user nova-compute[73007]:   <uuid>d9648621-6b91-4028-9f89-83302bc7a8cd</uuid>
Aug 15 17:52:00 user nova-compute[73007]:   <name>instance-0000001c</name>
Aug 15 17:52:00 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:52:00 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:52:00 user nova-compute[73007]:   <metadata>
Aug 15 17:52:00 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:52:00 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:52:00 user nova-compute[73007]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1509921233</nova:name>
Aug 15 17:52:00 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:52:00</nova:creationTime>
Aug 15 17:52:00 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:52:00 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:52:00 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:52:00 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:52:00 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:52:00 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:52:00 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:52:00 user nova-compute[73007]:       <nova:owner>
Aug 15 17:52:00 user nova-compute[73007]:         <nova:user uuid="f886ee6939504c4b9a406cedb9a65acc">tempest-ServerRescueNegativeTestJSON-1846740548-project-member</nova:user>
Aug 15 17:52:00 user nova-compute[73007]:         <nova:project uuid="8f94edb7a50c4e0e97ddc96c5c0028fc">tempest-ServerRescueNegativeTestJSON-1846740548</nova:project>
Aug 15 17:52:00 user nova-compute[73007]:       </nova:owner>
Aug 15 17:52:00 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:52:00 user nova-compute[73007]:       <nova:ports>
Aug 15 17:52:00 user nova-compute[73007]:         <nova:port uuid="d0452311-67f5-4735-b13c-a468d4b75e2d">
Aug 15 17:52:00 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:52:00 user nova-compute[73007]:         </nova:port>
Aug 15 17:52:00 user nova-compute[73007]:       </nova:ports>
Aug 15 17:52:00 user nova-compute[73007]:     </nova:instance>
Aug 15 17:52:00 user nova-compute[73007]:   </metadata>
Aug 15 17:52:00 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:52:00 user nova-compute[73007]:     <system>
Aug 15 17:52:00 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:52:00 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:52:00 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:52:00 user nova-compute[73007]:       <entry name="serial">d9648621-6b91-4028-9f89-83302bc7a8cd</entry>
Aug 15 17:52:00 user nova-compute[73007]:       <entry name="uuid">d9648621-6b91-4028-9f89-83302bc7a8cd</entry>
Aug 15 17:52:00 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:52:00 user nova-compute[73007]:     </system>
Aug 15 17:52:00 user nova-compute[73007]:   </sysinfo>
Aug 15 17:52:00 user nova-compute[73007]:   <os>
Aug 15 17:52:00 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:52:00 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:52:00 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:52:00 user nova-compute[73007]:   </os>
Aug 15 17:52:00 user nova-compute[73007]:   <features>
Aug 15 17:52:00 user nova-compute[73007]:     <acpi/>
Aug 15 17:52:00 user nova-compute[73007]:     <apic/>
Aug 15 17:52:00 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:52:00 user nova-compute[73007]:   </features>
Aug 15 17:52:00 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:52:00 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:52:00 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:52:00 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:52:00 user nova-compute[73007]:   </clock>
Aug 15 17:52:00 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:52:00 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:52:00 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:52:00 user nova-compute[73007]:   </cpu>
Aug 15 17:52:00 user nova-compute[73007]:   <devices>
Aug 15 17:52:00 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:52:00 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:52:00 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk"/>
Aug 15 17:52:00 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:52:00 user nova-compute[73007]:     </disk>
Aug 15 17:52:00 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:52:00 user nova-compute[73007]:       <mac address="fa:16:3e:70:ce:c8"/>
Aug 15 17:52:00 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:52:00 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:52:00 user nova-compute[73007]:       <target dev="tapd0452311-67"/>
Aug 15 17:52:00 user nova-compute[73007]:     </interface>
Aug 15 17:52:00 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:52:00 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/console.log" append="off"/>
Aug 15 17:52:00 user nova-compute[73007]:     </serial>
Aug 15 17:52:00 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:52:00 user nova-compute[73007]:     <video>
Aug 15 17:52:00 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:52:00 user nova-compute[73007]:     </video>
Aug 15 17:52:00 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:52:00 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:52:00 user nova-compute[73007]:     </rng>
Aug 15 17:52:00 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:52:00 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:52:00 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:52:00 user nova-compute[73007]:     </memballoon>
Aug 15 17:52:00 user nova-compute[73007]:   </devices>
Aug 15 17:52:00 user nova-compute[73007]: </domain>
Aug 15 17:52:00 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1509921233',display_name='tempest-ServerRescueNegativeTestJSON-server-1509921233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1509921233',id=28,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-nsttvj8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:51:58Z,user_data=None,user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=d9648621-6b91-4028-9f89-83302bc7a8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:ce:c8,bridge_name='br-int',has_traffic_filtering=True,id=d0452311-67f5-4735-b13c-a468d4b75e2d,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0452311-67') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG os_vif [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:ce:c8,bridge_name='br-int',has_traffic_filtering=True,id=d0452311-67f5-4735-b13c-a468d4b75e2d,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0452311-67') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0452311-67, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0452311-67, col_values=(('external_ids', {'iface-id': 'd0452311-67f5-4735-b13c-a468d4b75e2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:ce:c8', 'vm-uuid': 'd9648621-6b91-4028-9f89-83302bc7a8cd'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:00 user nova-compute[73007]: INFO os_vif [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:ce:c8,bridge_name='br-int',has_traffic_filtering=True,id=d0452311-67f5-4735-b13c-a468d4b75e2d,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0452311-67')
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No VIF found with MAC fa:16:3e:70:ce:c8, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26236376530366436', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236376530366436', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1935026486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1935026486',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIvgMz7mYpX7D05Wb4MZinjT0gPxrata4a0MrGnRjy415APQIOBp9A9kgHgddReowFznukjRHIxc2JaK1t+GuWtb14Fs3FEJXbWoBXhofsNDiEYHbnLbLukZFbdXs0nXg==',key_name='tempest-keypair-1261262527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ee8ba5df700457f9f97355fd864bece',ramdisk_id='',reservation_id='r-qcdh0wm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1292950819',owner_user_name='tempest-ServerActionsV293TestJSON-1292950819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de582a0433c424c8f7f76d74b9abe09',uuid=e6bc8143-ca4e-40cb-a38d-0a1caec7eb61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converting VIF {"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lazy-loading 'pci_devices' on Instance uuid e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.compute.manager [req-d2a1c74f-af96-4277-8b5b-a315abdff83c req-5bb6efdc-55aa-4200-a7e3-fc7d20fe84a2 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d2a1c74f-af96-4277-8b5b-a315abdff83c req-5bb6efdc-55aa-4200-a7e3-fc7d20fe84a2 service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d2a1c74f-af96-4277-8b5b-a315abdff83c req-5bb6efdc-55aa-4200-a7e3-fc7d20fe84a2 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d2a1c74f-af96-4277-8b5b-a315abdff83c req-5bb6efdc-55aa-4200-a7e3-fc7d20fe84a2 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.compute.manager [req-d2a1c74f-af96-4277-8b5b-a315abdff83c req-5bb6efdc-55aa-4200-a7e3-fc7d20fe84a2 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:01 user nova-compute[73007]: WARNING nova.compute.manager [req-d2a1c74f-af96-4277-8b5b-a315abdff83c req-5bb6efdc-55aa-4200-a7e3-fc7d20fe84a2 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state building and task_state spawning.
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:52:01 user nova-compute[73007]:   <uuid>e6bc8143-ca4e-40cb-a38d-0a1caec7eb61</uuid>
Aug 15 17:52:01 user nova-compute[73007]:   <name>instance-0000001a</name>
Aug 15 17:52:01 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:52:01 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:52:01 user nova-compute[73007]:   <metadata>
Aug 15 17:52:01 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:52:01 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:52:01 user nova-compute[73007]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1935026486</nova:name>
Aug 15 17:52:01 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:51:59</nova:creationTime>
Aug 15 17:52:01 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:52:01 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:52:01 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:52:01 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:52:01 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:52:01 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:52:01 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:52:01 user nova-compute[73007]:       <nova:owner>
Aug 15 17:52:01 user nova-compute[73007]:         <nova:user uuid="8de582a0433c424c8f7f76d74b9abe09">tempest-ServerActionsV293TestJSON-1292950819-project-member</nova:user>
Aug 15 17:52:01 user nova-compute[73007]:         <nova:project uuid="1ee8ba5df700457f9f97355fd864bece">tempest-ServerActionsV293TestJSON-1292950819</nova:project>
Aug 15 17:52:01 user nova-compute[73007]:       </nova:owner>
Aug 15 17:52:01 user nova-compute[73007]:       <nova:ports>
Aug 15 17:52:01 user nova-compute[73007]:         <nova:port uuid="e8a4549a-52c9-4091-a515-2515a704233a">
Aug 15 17:52:01 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:52:01 user nova-compute[73007]:         </nova:port>
Aug 15 17:52:01 user nova-compute[73007]:       </nova:ports>
Aug 15 17:52:01 user nova-compute[73007]:     </nova:instance>
Aug 15 17:52:01 user nova-compute[73007]:   </metadata>
Aug 15 17:52:01 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:52:01 user nova-compute[73007]:     <system>
Aug 15 17:52:01 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:52:01 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:52:01 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:52:01 user nova-compute[73007]:       <entry name="serial">e6bc8143-ca4e-40cb-a38d-0a1caec7eb61</entry>
Aug 15 17:52:01 user nova-compute[73007]:       <entry name="uuid">e6bc8143-ca4e-40cb-a38d-0a1caec7eb61</entry>
Aug 15 17:52:01 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:52:01 user nova-compute[73007]:     </system>
Aug 15 17:52:01 user nova-compute[73007]:   </sysinfo>
Aug 15 17:52:01 user nova-compute[73007]:   <os>
Aug 15 17:52:01 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:52:01 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:52:01 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:52:01 user nova-compute[73007]:   </os>
Aug 15 17:52:01 user nova-compute[73007]:   <features>
Aug 15 17:52:01 user nova-compute[73007]:     <acpi/>
Aug 15 17:52:01 user nova-compute[73007]:     <apic/>
Aug 15 17:52:01 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:52:01 user nova-compute[73007]:   </features>
Aug 15 17:52:01 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:52:01 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:52:01 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:52:01 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:52:01 user nova-compute[73007]:   </clock>
Aug 15 17:52:01 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:52:01 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:52:01 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:52:01 user nova-compute[73007]:   </cpu>
Aug 15 17:52:01 user nova-compute[73007]:   <devices>
Aug 15 17:52:01 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:52:01 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:52:01 user nova-compute[73007]:       <source dev="/dev/sdb"/>
Aug 15 17:52:01 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:52:01 user nova-compute[73007]:       <serial>8e090ef5-d29e-43bf-8295-960b3b25b00b</serial>
Aug 15 17:52:01 user nova-compute[73007]:     </disk>
Aug 15 17:52:01 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:52:01 user nova-compute[73007]:       <mac address="fa:16:3e:d1:2d:07"/>
Aug 15 17:52:01 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:52:01 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:52:01 user nova-compute[73007]:       <target dev="tape8a4549a-52"/>
Aug 15 17:52:01 user nova-compute[73007]:     </interface>
Aug 15 17:52:01 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:52:01 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/e6bc8143-ca4e-40cb-a38d-0a1caec7eb61/console.log" append="off"/>
Aug 15 17:52:01 user nova-compute[73007]:     </serial>
Aug 15 17:52:01 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:52:01 user nova-compute[73007]:     <video>
Aug 15 17:52:01 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:52:01 user nova-compute[73007]:     </video>
Aug 15 17:52:01 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:52:01 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:52:01 user nova-compute[73007]:     </rng>
Aug 15 17:52:01 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:52:01 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:52:01 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:52:01 user nova-compute[73007]:     </memballoon>
Aug 15 17:52:01 user nova-compute[73007]:   </devices>
Aug 15 17:52:01 user nova-compute[73007]: </domain>
Aug 15 17:52:01 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1935026486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1935026486',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIvgMz7mYpX7D05Wb4MZinjT0gPxrata4a0MrGnRjy415APQIOBp9A9kgHgddReowFznukjRHIxc2JaK1t+GuWtb14Fs3FEJXbWoBXhofsNDiEYHbnLbLukZFbdXs0nXg==',key_name='tempest-keypair-1261262527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ee8ba5df700457f9f97355fd864bece',ramdisk_id='',reservation_id='r-qcdh0wm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1292950819',owner_user_name='tempest-ServerActionsV293TestJSON-1292950819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de582a0433c424c8f7f76d74b9abe09',uuid=e6bc8143-ca4e-40cb-a38d-0a1caec7eb61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converting VIF {"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_vif [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:01 user nova-compute[73007]: INFO nova.compute.manager [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Attaching volume 7f35b3d7-7b01-431d-b76e-c6112459e995 to /dev/vdb
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8a4549a-52, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8a4549a-52, col_values=(('external_ids', {'iface-id': 'e8a4549a-52c9-4091-a515-2515a704233a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:2d:07', 'vm-uuid': 'e6bc8143-ca4e-40cb-a38d-0a1caec7eb61'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:01 user nova-compute[73007]: INFO os_vif [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52')
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_brick.utils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] No VIF found with MAC fa:16:3e:d1:2d:07, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[85426f01-b41f-415f-bc77-75e707b3fd99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-cc4cf8ca-39d0-4948-9fd5-aaeb4a5a19de req-f9891c59-b478-455a-8507-9dbc9cd97381 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Updated VIF entry in instance network info cache for port d0452311-67f5-4735-b13c-a468d4b75e2d. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-cc4cf8ca-39d0-4948-9fd5-aaeb4a5a19de req-f9891c59-b478-455a-8507-9dbc9cd97381 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Updating instance_info_cache with network_info: [{"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5f2e8-bc02-4e23-8574-c591fc411419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cc4cf8ca-39d0-4948-9fd5-aaeb4a5a19de req-f9891c59-b478-455a-8507-9dbc9cd97381 service nova] Releasing lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6310511-aa41-458e-9d0b-51b6d492e2b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274560c-be75-4733-85bb-f09bb08dc8e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:52:01 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:52:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[76521ce3-e949-4183-a406-806031f90652]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG os_brick.utils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Updating existing volume attachment record: 442acc9d-76ba-453d-8b16-fef4e1534f5d {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-edb76091-73be-44f5-a41c-fcabc3d4ad6d req-bfffdbab-58a9-4ba3-8b65-ccd81005baba service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edb76091-73be-44f5-a41c-fcabc3d4ad6d req-bfffdbab-58a9-4ba3-8b65-ccd81005baba service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edb76091-73be-44f5-a41c-fcabc3d4ad6d req-bfffdbab-58a9-4ba3-8b65-ccd81005baba service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edb76091-73be-44f5-a41c-fcabc3d4ad6d req-bfffdbab-58a9-4ba3-8b65-ccd81005baba service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-edb76091-73be-44f5-a41c-fcabc3d4ad6d req-bfffdbab-58a9-4ba3-8b65-ccd81005baba service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:03 user nova-compute[73007]: WARNING nova.compute.manager [req-edb76091-73be-44f5-a41c-fcabc3d4ad6d req-bfffdbab-58a9-4ba3-8b65-ccd81005baba service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state building and task_state spawning.
Aug 15 17:52:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-d331730f-a129-4e6a-b1d1-4d32900f47a5 req-3edcc6b9-8ec9-467e-b7e9-88217612b4f3 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d331730f-a129-4e6a-b1d1-4d32900f47a5 req-3edcc6b9-8ec9-467e-b7e9-88217612b4f3 service nova] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d331730f-a129-4e6a-b1d1-4d32900f47a5 req-3edcc6b9-8ec9-467e-b7e9-88217612b4f3 service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d331730f-a129-4e6a-b1d1-4d32900f47a5 req-3edcc6b9-8ec9-467e-b7e9-88217612b4f3 service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-d331730f-a129-4e6a-b1d1-4d32900f47a5 req-3edcc6b9-8ec9-467e-b7e9-88217612b4f3 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] No waiting events found dispatching network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:03 user nova-compute[73007]: WARNING nova.compute.manager [req-d331730f-a129-4e6a-b1d1-4d32900f47a5 req-3edcc6b9-8ec9-467e-b7e9-88217612b4f3 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received unexpected event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d for instance with vm_state building and task_state spawning.
Aug 15 17:52:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-d10f852a-29bb-4335-af79-8f4af62616f4 req-1ff0768f-2d97-4b87-acfd-2d82ac8b2503 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d10f852a-29bb-4335-af79-8f4af62616f4 req-1ff0768f-2d97-4b87-acfd-2d82ac8b2503 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d10f852a-29bb-4335-af79-8f4af62616f4 req-1ff0768f-2d97-4b87-acfd-2d82ac8b2503 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d10f852a-29bb-4335-af79-8f4af62616f4 req-1ff0768f-2d97-4b87-acfd-2d82ac8b2503 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-d10f852a-29bb-4335-af79-8f4af62616f4 req-1ff0768f-2d97-4b87-acfd-2d82ac8b2503 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:03 user nova-compute[73007]: WARNING nova.compute.manager [req-d10f852a-29bb-4335-af79-8f4af62616f4 req-1ff0768f-2d97-4b87-acfd-2d82ac8b2503 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state building and task_state spawning.
Aug 15 17:52:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121924.9353316, b8628c95-e352-41e4-b7d5-af0aa9ebcb0c => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:04 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] VM Resumed (Lifecycle Event)
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:52:04 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance spawned successfully.
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:04 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:52:04 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121924.9365506, b8628c95-e352-41e4-b7d5-af0aa9ebcb0c => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:04 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] VM Started (Lifecycle Event)
Aug 15 17:52:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:52:05 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:52:05 user nova-compute[73007]: INFO nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Took 8.22 seconds to spawn the instance on the hypervisor.
Aug 15 17:52:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:05 user nova-compute[73007]: INFO nova.compute.manager [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Took 9.34 seconds to build instance.
Aug 15 17:52:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffd9cdc1-fa76-4841-80d7-ab9201534132 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.501s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-cd5d27f5-2ee3-41c4-8dc8-39cf1c4e55d0 req-5f8a4c33-e501-4234-aa05-4dfb86fae535 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cd5d27f5-2ee3-41c4-8dc8-39cf1c4e55d0 req-5f8a4c33-e501-4234-aa05-4dfb86fae535 service nova] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cd5d27f5-2ee3-41c4-8dc8-39cf1c4e55d0 req-5f8a4c33-e501-4234-aa05-4dfb86fae535 service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cd5d27f5-2ee3-41c4-8dc8-39cf1c4e55d0 req-5f8a4c33-e501-4234-aa05-4dfb86fae535 service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-cd5d27f5-2ee3-41c4-8dc8-39cf1c4e55d0 req-5f8a4c33-e501-4234-aa05-4dfb86fae535 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] No waiting events found dispatching network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:05 user nova-compute[73007]: WARNING nova.compute.manager [req-cd5d27f5-2ee3-41c4-8dc8-39cf1c4e55d0 req-5f8a4c33-e501-4234-aa05-4dfb86fae535 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received unexpected event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d for instance with vm_state building and task_state spawning.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-6caebedc-abc1-4e15-a4db-1d5124da8caf req-38f0bce6-a9b5-4b45-b0ea-ad81b1dd7eb1 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6caebedc-abc1-4e15-a4db-1d5124da8caf req-38f0bce6-a9b5-4b45-b0ea-ad81b1dd7eb1 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6caebedc-abc1-4e15-a4db-1d5124da8caf req-38f0bce6-a9b5-4b45-b0ea-ad81b1dd7eb1 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6caebedc-abc1-4e15-a4db-1d5124da8caf req-38f0bce6-a9b5-4b45-b0ea-ad81b1dd7eb1 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-6caebedc-abc1-4e15-a4db-1d5124da8caf req-38f0bce6-a9b5-4b45-b0ea-ad81b1dd7eb1 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:06 user nova-compute[73007]: WARNING nova.compute.manager [req-6caebedc-abc1-4e15-a4db-1d5124da8caf req-38f0bce6-a9b5-4b45-b0ea-ad81b1dd7eb1 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state building and task_state spawning.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121926.336196, d9648621-6b91-4028-9f89-83302bc7a8cd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] VM Resumed (Lifecycle Event)
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Instance spawned successfully.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance spawned successfully.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121926.3374736, d9648621-6b91-4028-9f89-83302bc7a8cd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] VM Started (Lifecycle Event)
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Took 8.55 seconds to spawn the instance on the hypervisor.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121926.3454368, e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] VM Resumed (Lifecycle Event)
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Took 6.84 seconds to spawn the instance on the hypervisor.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121926.346911, e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] VM Started (Lifecycle Event)
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Took 9.68 seconds to build instance.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-abade9b1-c0b9-4b20-8232-c6148995732d tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.774s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:06 user nova-compute[73007]: INFO nova.compute.manager [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Took 18.21 seconds to build instance.
Aug 15 17:52:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3a2d1be0-05c6-4959-bbcb-a36124bcf923 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.337s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121916.4283764, 384f0339-eed5-4573-90fb-1dd91c4cce90 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:11 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] VM Stopped (Lifecycle Event)
Aug 15 17:52:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-74839992-5903-4d45-ae46-ed62a4806a67 None None] [instance: 384f0339-eed5-4573-90fb-1dd91c4cce90] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnNUjDkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:52:11 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:52:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:52:11 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:52:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:52:11 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:52:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a298bb02-4278-4ff4-b5ff-51fb1a035dc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:52:11 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1d44f2-6d86-4ae9-91c4-7c60cb7bc516]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995] added
Aug 15 17:52:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e2931-fef2-4f0e-b33b-4985ce3e68bc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60e74e-5f22-43bc-81a1-b38fed5df559]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnNUjDkz {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnNUjDkz" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8544fb-96d6-416d-af81-da3d1dd7494d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pnNUjDkz'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c62d8e-b98b-4e41-b415-ceb965a0477f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f907edb-aecd-4f98-a253-40d9a816fb7e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[68420292-3168-421c-9892-6d6eca9aad3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995, portal: 172.16.0.220,3260]
Aug 15 17:52:12 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995, portal: 172.16.0.220,3260] successful.
Aug 15 17:52:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d08faef-4956-42b9-b414-a99fe7ae0bf8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09fd30a-574a-488d-890f-d002074e0cc7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 (non-flash)
Aug 15 17:52:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:12 user nova-compute[73007]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 (non-flash)
Aug 15 17:52:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb14c2a3-e611-4474-86a0-c889e60b9619]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnNUjDkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:52:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26430653534356133', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430653534356133', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:52:13 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:52:13 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:52:13 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:52:13 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:52:13 user nova-compute[73007]:   <serial>7f35b3d7-7b01-431d-b76e-c6112459e995</serial>
Aug 15 17:52:13 user nova-compute[73007]: </disk>
Aug 15 17:52:13 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:52:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:52:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:52:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No VIF found with MAC fa:16:3e:e5:48:83, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:52:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c9f7d30d-ea3c-4dd1-80de-6602bed9e898 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.874s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:14 user nova-compute[73007]: INFO nova.compute.manager [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Detaching volume 7f35b3d7-7b01-431d-b76e-c6112459e995
Aug 15 17:52:14 user nova-compute[73007]: INFO nova.virt.block_device [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Attempting to driver detach volume 7f35b3d7-7b01-431d-b76e-c6112459e995 from mountpoint /dev/vdb
Aug 15 17:52:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Attempting to detach device vdb from instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:52:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:52:14 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:52:14 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:52:14 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:52:14 user nova-compute[73007]:   <serial>7f35b3d7-7b01-431d-b76e-c6112459e995</serial>
Aug 15 17:52:14 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:52:14 user nova-compute[73007]: </disk>
Aug 15 17:52:14 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:52:14 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully detached device vdb from instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a from the persistent domain config.
Aug 15 17:52:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:52:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:52:14 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:52:14 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:52:14 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:52:14 user nova-compute[73007]:   <serial>7f35b3d7-7b01-431d-b76e-c6112459e995</serial>
Aug 15 17:52:14 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:52:14 user nova-compute[73007]: </disk>
Aug 15 17:52:14 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121935.130008, eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:52:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully detached device vdb from instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a from the live domain config.
Aug 15 17:52:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnNUjDkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:52:15 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c20d54-fb40-446b-a75a-c7a3844a9f8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8b4253-630b-4e13-966f-63688adf402c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:15 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:15 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:15 user nova-compute[73007]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 (non-flash)
Aug 15 17:52:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:15 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:15 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:15 user nova-compute[73007]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 (non-flash)
Aug 15 17:52:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11505db910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4de28d-dbe6-417a-856c-b142d637829f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc0ea24-cc05-40e5-9f7a-c72b3955f12b]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5f0b06-c333-4d2b-9eee-ee284fe9bf6b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.070s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b60d18e-ff5e-4845-8810-dbc68f0256be]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86a6add-c3e1-44a0-92da-a29a5e85ff49]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[af73abaa-77d9-495e-a781-fb6238cc539a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995, portal: 172.16.0.220,3260]
Aug 15 17:52:15 user nova-compute[73007]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995, portal: 172.16.0.220,3260] successful.
Aug 15 17:52:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f35b3d7-7b01-431d-b76e-c6112459e995 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2053e62e-a8d0-437f-9b0f-bf55dc39710a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== disconnect_volume: return (322ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:52:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:16 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ef395126-985e-4337-8f40-5c92e017b900 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.666s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:18 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:18 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:52:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Updating instance_info_cache with network_info: [{"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-64379e41-9e78-4389-aee2-14388d2366d5" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:23 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:52:23 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=6859MB free_disk=25.433998107910156GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 42c38120-5e1d-4438-a53b-8a188e417c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 35fd679b-f098-4905-aa23-1fce430265bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 70146485-1eef-4e98-88d3-01f14133c3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 81fc8cd9-5759-4d17-9ff5-6e1c249d376f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:52:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:52:33 user nova-compute[73007]: INFO nova.compute.claims [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Claim successful on node user
Aug 15 17:52:33 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:52:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:52:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:52:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:52:34 user nova-compute[73007]: INFO nova.virt.block_device [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Booting with blank volume at /dev/vda
Aug 15 17:52:34 user nova-compute[73007]: DEBUG nova.policy [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b7b5264253d44e9a51d06f66bed1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e88231a35bb4a2e8b5e1e7d5e5f9418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:52:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Successfully created port: a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:52:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:34 user nova-compute[73007]: INFO nova.compute.manager [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Detaching volume 0f331d2b-8093-455f-beff-d28224a7170a
Aug 15 17:52:34 user nova-compute[73007]: INFO nova.virt.block_device [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Attempting to driver detach volume 0f331d2b-8093-455f-beff-d28224a7170a from mountpoint /dev/vdb
Aug 15 17:52:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Attempting to detach device vdb from instance 35fd679b-f098-4905-aa23-1fce430265bd from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:52:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:52:34 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:52:34 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 17:52:34 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:52:34 user nova-compute[73007]:   <serial>0f331d2b-8093-455f-beff-d28224a7170a</serial>
Aug 15 17:52:34 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:52:34 user nova-compute[73007]: </disk>
Aug 15 17:52:34 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:52:34 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Successfully detached device vdb from instance 35fd679b-f098-4905-aa23-1fce430265bd from the persistent domain config.
Aug 15 17:52:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35fd679b-f098-4905-aa23-1fce430265bd from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:52:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:52:34 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:52:34 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 17:52:34 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:52:34 user nova-compute[73007]:   <serial>0f331d2b-8093-455f-beff-d28224a7170a</serial>
Aug 15 17:52:34 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:52:34 user nova-compute[73007]: </disk>
Aug 15 17:52:34 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692121955.4084518, 35fd679b-f098-4905-aa23-1fce430265bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:52:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Successfully detached device vdb from instance 35fd679b-f098-4905-aa23-1fce430265bd from the live domain config.
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yqSLmBzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:52:35 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e46042-d293-482c-8729-9738e2c66e2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11afc86-6d98-4d70-a19a-34208fa659e0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:35 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:35 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a (non-flash)
Aug 15 17:52:35 user nova-compute[73007]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:35 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7bc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a'): ({'sdc'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Removing single pathed devices sdc {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a167cd0-30b1-46fe-b769-e693a49110d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[69240970-d0ea-4375-96bf-694344233243]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Flushing IO for device /dev/sdc {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Successfully updated port: a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7260202-4c3d-45c3-b19d-4e55451f2489]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquired lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-9005c945-a0fd-4b95-a1b9-565a9585f04c req-8cf2fa58-da5c-4811-aeef-fd656ab8979c service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-changed-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-9005c945-a0fd-4b95-a1b9-565a9585f04c req-8cf2fa58-da5c-4811-aeef-fd656ab8979c service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Refreshing instance network info cache due to event network-changed-a994297e-f116-4704-93f6-99f23e05ca85. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9005c945-a0fd-4b95-a1b9-565a9585f04c req-8cf2fa58-da5c-4811-aeef-fd656ab8979c service nova] Acquiring lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05aa97-7aa6-4ea6-8935-45b0f2383d73]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9958f63c-fc3f-45c2-b105-5454d448cbe1]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b6be85-05c8-4ae2-87ef-b753cb82ff26]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a, portal: 172.16.0.220,3260]
Aug 15 17:52:35 user nova-compute[73007]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a, portal: 172.16.0.220,3260] successful.
Aug 15 17:52:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f331d2b-8093-455f-beff-d28224a7170a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[01520bfd-1018-49da-84d3-41392ac17505]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] <== disconnect_volume: return (279ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updating instance_info_cache with network_info: [{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Releasing lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance network_info: |[{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9005c945-a0fd-4b95-a1b9-565a9585f04c req-8cf2fa58-da5c-4811-aeef-fd656ab8979c service nova] Acquired lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-9005c945-a0fd-4b95-a1b9-565a9585f04c req-8cf2fa58-da5c-4811-aeef-fd656ab8979c service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Refreshing network info cache for port a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:52:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:36 user nova-compute[73007]: DEBUG nova.network.neutron [req-9005c945-a0fd-4b95-a1b9-565a9585f04c req-8cf2fa58-da5c-4811-aeef-fd656ab8979c service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updated VIF entry in instance network info cache for port a994297e-f116-4704-93f6-99f23e05ca85. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:52:36 user nova-compute[73007]: DEBUG nova.network.neutron [req-9005c945-a0fd-4b95-a1b9-565a9585f04c req-8cf2fa58-da5c-4811-aeef-fd656ab8979c service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updating instance_info_cache with network_info: [{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9005c945-a0fd-4b95-a1b9-565a9585f04c req-8cf2fa58-da5c-4811-aeef-fd656ab8979c service nova] Releasing lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'flavor' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38a29bd3-6c05-46d9-9edc-9db11e32c749 tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.737s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-b62b94cc-1b05-40a5-a72f-876e5ff7bf4f req-9422eadd-56f0-498c-b91e-3cd272a3bc33 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-changed-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-b62b94cc-1b05-40a5-a72f-876e5ff7bf4f req-9422eadd-56f0-498c-b91e-3cd272a3bc33 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Refreshing instance network info cache due to event network-changed-aa84c30b-91eb-44eb-8b98-b64d96aab4af. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:52:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b62b94cc-1b05-40a5-a72f-876e5ff7bf4f req-9422eadd-56f0-498c-b91e-3cd272a3bc33 service nova] Acquiring lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b62b94cc-1b05-40a5-a72f-876e5ff7bf4f req-9422eadd-56f0-498c-b91e-3cd272a3bc33 service nova] Acquired lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-b62b94cc-1b05-40a5-a72f-876e5ff7bf4f req-9422eadd-56f0-498c-b91e-3cd272a3bc33 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Refreshing network info cache for port aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:52:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-b62b94cc-1b05-40a5-a72f-876e5ff7bf4f req-9422eadd-56f0-498c-b91e-3cd272a3bc33 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updated VIF entry in instance network info cache for port aa84c30b-91eb-44eb-8b98-b64d96aab4af. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:52:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-b62b94cc-1b05-40a5-a72f-876e5ff7bf4f req-9422eadd-56f0-498c-b91e-3cd272a3bc33 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b62b94cc-1b05-40a5-a72f-876e5ff7bf4f req-9422eadd-56f0-498c-b91e-3cd272a3bc33 service nova] Releasing lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG os_brick.utils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdaee5c-ed9a-4331-aa2a-cd6ad4676b51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[41972353-11b6-4a74-87d7-89785f83bff1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba87352-c48a-4174-98b0-de4de63b0dbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe27845-601b-420c-b1c6-959ea4785ec9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:52:39 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:52:39 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db49268-f871-45a5-b88e-af60545faeca]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG os_brick.utils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:39 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updating existing volume attachment record: be486afb-f9b7-44ee-8aef-aab4df09932e {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:52:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:42 user nova-compute[73007]: INFO nova.compute.manager [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Shelving
Aug 15 17:52:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-613aeb59-e6eb-49fa-87df-2fb19cd7ace8 req-b54baf49-9def-4877-a0cf-91e4a18f6cb6 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-unplugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-613aeb59-e6eb-49fa-87df-2fb19cd7ace8 req-b54baf49-9def-4877-a0cf-91e4a18f6cb6 service nova] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-613aeb59-e6eb-49fa-87df-2fb19cd7ace8 req-b54baf49-9def-4877-a0cf-91e4a18f6cb6 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-613aeb59-e6eb-49fa-87df-2fb19cd7ace8 req-b54baf49-9def-4877-a0cf-91e4a18f6cb6 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-613aeb59-e6eb-49fa-87df-2fb19cd7ace8 req-b54baf49-9def-4877-a0cf-91e4a18f6cb6 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] No waiting events found dispatching network-vif-unplugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:43 user nova-compute[73007]: WARNING nova.compute.manager [req-613aeb59-e6eb-49fa-87df-2fb19cd7ace8 req-b54baf49-9def-4877-a0cf-91e4a18f6cb6 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received unexpected event network-vif-unplugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af for instance with vm_state active and task_state shelving.
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'flavor' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance destroyed successfully.
Aug 15 17:52:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Beginning cold snapshot process
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:43 user nova-compute[73007]: INFO nova.compute.manager [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Attaching volume 8f4a21dd-e2fe-4302-beb7-ec9a094317f7 to /dev/vdb
Aug 15 17:52:43 user nova-compute[73007]: DEBUG os_brick.utils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98230ba-e5ef-4ab4-943b-bbafc45cea60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b01815-e8d2-4c92-a0f2-5f450786a645]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[82640b67-e0b6-4ba1-8709-9078b322e2bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9f14d7-cf83-4841-97fa-6a6b0d24ef55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk /opt/stack/data/nova/instances/snapshots/tmp8ys80k1t/40b7aaa4b00c4d608ecb2f6ea4fb011f {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:52:43 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:52:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7bfaf-f4a6-4526-82d6-82c39acae33a]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG os_brick.utils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:43 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating existing volume attachment record: 01b9c7bd-ecda-4bc4-9c0c-ee2a308f6be7 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:52:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk /opt/stack/data/nova/instances/snapshots/tmp8ys80k1t/40b7aaa4b00c4d608ecb2f6ea4fb011f" returned: 0 in 0.776s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Snapshot extracted, beginning image upload
Aug 15 17:52:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-04c51f84-e734-4423-8cd7-e02cd6b16259 req-30f6e24e-1da6-43d8-a2e7-2ead1f809d91 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-04c51f84-e734-4423-8cd7-e02cd6b16259 req-30f6e24e-1da6-43d8-a2e7-2ead1f809d91 service nova] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-04c51f84-e734-4423-8cd7-e02cd6b16259 req-30f6e24e-1da6-43d8-a2e7-2ead1f809d91 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-04c51f84-e734-4423-8cd7-e02cd6b16259 req-30f6e24e-1da6-43d8-a2e7-2ead1f809d91 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-04c51f84-e734-4423-8cd7-e02cd6b16259 req-30f6e24e-1da6-43d8-a2e7-2ead1f809d91 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] No waiting events found dispatching network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:45 user nova-compute[73007]: WARNING nova.compute.manager [req-04c51f84-e734-4423-8cd7-e02cd6b16259 req-30f6e24e-1da6-43d8-a2e7-2ead1f809d91 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received unexpected event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 17:52:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:47 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Snapshot image upload complete
Aug 15 17:52:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:47 user nova-compute[73007]: INFO nova.compute.manager [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Shelve offloading
Aug 15 17:52:47 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance destroyed successfully.
Aug 15 17:52:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquired lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-983729e4-1658-4eb8-9c2c-9eaa972be0a0 req-f736bd36-125e-4512-a1ee-8bf74c5a43d7 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-changed-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-983729e4-1658-4eb8-9c2c-9eaa972be0a0 req-f736bd36-125e-4512-a1ee-8bf74c5a43d7 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Refreshing instance network info cache due to event network-changed-06d8a570-8b59-44eb-874e-55022131b039. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-983729e4-1658-4eb8-9c2c-9eaa972be0a0 req-f736bd36-125e-4512-a1ee-8bf74c5a43d7 service nova] Acquiring lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-983729e4-1658-4eb8-9c2c-9eaa972be0a0 req-f736bd36-125e-4512-a1ee-8bf74c5a43d7 service nova] Acquired lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG nova.network.neutron [req-983729e4-1658-4eb8-9c2c-9eaa972be0a0 req-f736bd36-125e-4512-a1ee-8bf74c5a43d7 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Refreshing network info cache for port 06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG nova.network.neutron [req-983729e4-1658-4eb8-9c2c-9eaa972be0a0 req-f736bd36-125e-4512-a1ee-8bf74c5a43d7 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updated VIF entry in instance network info cache for port 06d8a570-8b59-44eb-874e-55022131b039. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG nova.network.neutron [req-983729e4-1658-4eb8-9c2c-9eaa972be0a0 req-f736bd36-125e-4512-a1ee-8bf74c5a43d7 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-983729e4-1658-4eb8-9c2c-9eaa972be0a0 req-f736bd36-125e-4512-a1ee-8bf74c5a43d7 service nova] Releasing lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Releasing lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance destroyed successfully.
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'resources' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-232696881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-232696881',id=23,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYKKn1zc7cLwaJHycfMRCUe3YnDt3y7A79ahGepGzTkEVLNObE43i0Doaok1k/oAziNKotR0bmsCoqoc2xw31+wptNoF3yFPuYZNAyQBHnj0b2/qeCEvo1w9zDfEni0Kg==',key_name='tempest-keypair-1670192498',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-rahs12xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member',shelved_at='2023-08-15T17:52:47.227278',shelved_host='user',shelved_image_id='ad8381c7-fc9e-4822-a968-9dd3f74618cb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:52:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=70146485-1eef-4e98-88d3-01f14133c3f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG os_vif [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa84c30b-91, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:48 user nova-compute[73007]: INFO os_vif [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91')
Aug 15 17:52:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Deleting instance files /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7_del
Aug 15 17:52:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Deletion of /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7_del complete
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-82e56314-cdc6-4b5b-a386-ca0b5c18cb23 req-7d2008a5-9403-43bd-a3ab-75bbb9e69882 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-changed-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-82e56314-cdc6-4b5b-a386-ca0b5c18cb23 req-7d2008a5-9403-43bd-a3ab-75bbb9e69882 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Refreshing instance network info cache due to event network-changed-aa84c30b-91eb-44eb-8b98-b64d96aab4af. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-82e56314-cdc6-4b5b-a386-ca0b5c18cb23 req-7d2008a5-9403-43bd-a3ab-75bbb9e69882 service nova] Acquiring lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-82e56314-cdc6-4b5b-a386-ca0b5c18cb23 req-7d2008a5-9403-43bd-a3ab-75bbb9e69882 service nova] Acquired lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-82e56314-cdc6-4b5b-a386-ca0b5c18cb23 req-7d2008a5-9403-43bd-a3ab-75bbb9e69882 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Refreshing network info cache for port aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:52:48 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Deleted allocations for instance 70146485-1eef-4e98-88d3-01f14133c3f7
Aug 15 17:52:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:48 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'numa_topology' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-82e56314-cdc6-4b5b-a386-ca0b5c18cb23 req-7d2008a5-9403-43bd-a3ab-75bbb9e69882 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updated VIF entry in instance network info cache for port aa84c30b-91eb-44eb-8b98-b64d96aab4af. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-82e56314-cdc6-4b5b-a386-ca0b5c18cb23 req-7d2008a5-9403-43bd-a3ab-75bbb9e69882 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapaa84c30b-91", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-82e56314-cdc6-4b5b-a386-ca0b5c18cb23 req-7d2008a5-9403-43bd-a3ab-75bbb9e69882 service nova] Releasing lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ffbafa28-7c11-4bb2-8e65-a56f9de26102 tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.504s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:52:49 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Creating image(s)
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Ensure instance console log exists: /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Start _get_guest_xml network_info=[{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTqhdmxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8047564-c2ee-43f4-b423-cc9c686eabc1', 'attached_at': '', 'detached_at': '', 'volume_id': 'e90625eb-7440-48c6-8d3e-b9abdd875692', 'serial': 'e90625eb-7440-48c6-8d3e-b9abdd875692'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'be486afb-f9b7-44ee-8aef-aab4df09932e', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:52:49 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:52:49 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTqhdmxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:52:49 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:52:49 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:52:49 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad17e491-9eea-40af-bb29-b5b44cf6c254]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:52:49 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4c9170-945d-450d-ac7b-eb8a356c73fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692] added
Aug 15 17:52:49 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd651267-ddf8-4255-a75f-0e5ffad5ca5b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30fed56-a719-48be-a0d8-7a91e9a59e34]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTqhdmxG {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTqhdmxG" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[397345ed-07ef-4658-b9cf-bdf40059a99c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTqhdmxG'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdaa9b3-1231-494e-a916-e0763c37df3c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62fca38-39db-4bba-8933-edebf2944b5d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:49 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:49 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:49 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:49 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac96a4c2-5bb3-4f21-a056-4dbe79eb8ed5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692, portal: 172.16.0.220,3260]
Aug 15 17:52:49 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692, portal: 172.16.0.220,3260] successful.
Aug 15 17:52:49 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ccce7f-f591-40ed-9592-48cfca663dcc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9c15ae-7d97-465a-9429-9d2cbbbd51f1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:49 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:49 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:52:49 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:49 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:49 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:52:49 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ebad13-d788-4e65-af83-b9de7b668c4f]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:52:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTqhdmxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23037343535353861', 'path': '/dev/sdc'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037343535353861', 'path': '/dev/sdc'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-562465900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-562465900',id=29,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-c8534a7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:52:34Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=c8047564-c2ee-43f4-b423-cc9c686eabc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7a:fe,bridge_name='br-int',has_traffic_filtering=True,id=a994297e-f116-4704-93f6-99f23e05ca85,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa994297e-f1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'pci_devices' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:52:50 user nova-compute[73007]:   <uuid>c8047564-c2ee-43f4-b423-cc9c686eabc1</uuid>
Aug 15 17:52:50 user nova-compute[73007]:   <name>instance-0000001d</name>
Aug 15 17:52:50 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:52:50 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:52:50 user nova-compute[73007]:   <metadata>
Aug 15 17:52:50 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:52:50 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:52:50 user nova-compute[73007]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-562465900</nova:name>
Aug 15 17:52:50 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:52:49</nova:creationTime>
Aug 15 17:52:50 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:52:50 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:52:50 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:52:50 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:52:50 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:52:50 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:52:50 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:52:50 user nova-compute[73007]:       <nova:owner>
Aug 15 17:52:50 user nova-compute[73007]:         <nova:user uuid="2b7b5264253d44e9a51d06f66bed1443">tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member</nova:user>
Aug 15 17:52:50 user nova-compute[73007]:         <nova:project uuid="6e88231a35bb4a2e8b5e1e7d5e5f9418">tempest-ServerBootFromVolumeStableRescueTest-452961283</nova:project>
Aug 15 17:52:50 user nova-compute[73007]:       </nova:owner>
Aug 15 17:52:50 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:52:50 user nova-compute[73007]:       <nova:ports>
Aug 15 17:52:50 user nova-compute[73007]:         <nova:port uuid="a994297e-f116-4704-93f6-99f23e05ca85">
Aug 15 17:52:50 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 17:52:50 user nova-compute[73007]:         </nova:port>
Aug 15 17:52:50 user nova-compute[73007]:       </nova:ports>
Aug 15 17:52:50 user nova-compute[73007]:     </nova:instance>
Aug 15 17:52:50 user nova-compute[73007]:   </metadata>
Aug 15 17:52:50 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:52:50 user nova-compute[73007]:     <system>
Aug 15 17:52:50 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:52:50 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:52:50 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:52:50 user nova-compute[73007]:       <entry name="serial">c8047564-c2ee-43f4-b423-cc9c686eabc1</entry>
Aug 15 17:52:50 user nova-compute[73007]:       <entry name="uuid">c8047564-c2ee-43f4-b423-cc9c686eabc1</entry>
Aug 15 17:52:50 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:52:50 user nova-compute[73007]:     </system>
Aug 15 17:52:50 user nova-compute[73007]:   </sysinfo>
Aug 15 17:52:50 user nova-compute[73007]:   <os>
Aug 15 17:52:50 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:52:50 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:52:50 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:52:50 user nova-compute[73007]:   </os>
Aug 15 17:52:50 user nova-compute[73007]:   <features>
Aug 15 17:52:50 user nova-compute[73007]:     <acpi/>
Aug 15 17:52:50 user nova-compute[73007]:     <apic/>
Aug 15 17:52:50 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:52:50 user nova-compute[73007]:   </features>
Aug 15 17:52:50 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:52:50 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:52:50 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:52:50 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:52:50 user nova-compute[73007]:   </clock>
Aug 15 17:52:50 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:52:50 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:52:50 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:52:50 user nova-compute[73007]:   </cpu>
Aug 15 17:52:50 user nova-compute[73007]:   <devices>
Aug 15 17:52:50 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:52:50 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:52:50 user nova-compute[73007]:       <source dev="/dev/sdc"/>
Aug 15 17:52:50 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:52:50 user nova-compute[73007]:       <serial>e90625eb-7440-48c6-8d3e-b9abdd875692</serial>
Aug 15 17:52:50 user nova-compute[73007]:     </disk>
Aug 15 17:52:50 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:52:50 user nova-compute[73007]:       <mac address="fa:16:3e:22:7a:fe"/>
Aug 15 17:52:50 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:52:50 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:52:50 user nova-compute[73007]:       <target dev="tapa994297e-f1"/>
Aug 15 17:52:50 user nova-compute[73007]:     </interface>
Aug 15 17:52:50 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:52:50 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/console.log" append="off"/>
Aug 15 17:52:50 user nova-compute[73007]:     </serial>
Aug 15 17:52:50 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:52:50 user nova-compute[73007]:     <video>
Aug 15 17:52:50 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:52:50 user nova-compute[73007]:     </video>
Aug 15 17:52:50 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:52:50 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:52:50 user nova-compute[73007]:     </rng>
Aug 15 17:52:50 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:52:50 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:52:50 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:52:50 user nova-compute[73007]:     </memballoon>
Aug 15 17:52:50 user nova-compute[73007]:   </devices>
Aug 15 17:52:50 user nova-compute[73007]: </domain>
Aug 15 17:52:50 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-562465900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-562465900',id=29,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-c8534a7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:52:34Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=c8047564-c2ee-43f4-b423-cc9c686eabc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7a:fe,bridge_name='br-int',has_traffic_filtering=True,id=a994297e-f116-4704-93f6-99f23e05ca85,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa994297e-f1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG os_vif [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7a:fe,bridge_name='br-int',has_traffic_filtering=True,id=a994297e-f116-4704-93f6-99f23e05ca85,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa994297e-f1') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa994297e-f1, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa994297e-f1, col_values=(('external_ids', {'iface-id': 'a994297e-f116-4704-93f6-99f23e05ca85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:7a:fe', 'vm-uuid': 'c8047564-c2ee-43f4-b423-cc9c686eabc1'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:52:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:50 user nova-compute[73007]: INFO os_vif [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7a:fe,bridge_name='br-int',has_traffic_filtering=True,id=a994297e-f116-4704-93f6-99f23e05ca85,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa994297e-f1')
Aug 15 17:52:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:52:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No VIF found with MAC fa:16:3e:22:7a:fe, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-20cd5bae-0883-43fd-9b6d-c0ceb23c3ea1 req-576d49d0-a695-4e71-8b41-dcec59d2f830 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-20cd5bae-0883-43fd-9b6d-c0ceb23c3ea1 req-576d49d0-a695-4e71-8b41-dcec59d2f830 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-20cd5bae-0883-43fd-9b6d-c0ceb23c3ea1 req-576d49d0-a695-4e71-8b41-dcec59d2f830 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-20cd5bae-0883-43fd-9b6d-c0ceb23c3ea1 req-576d49d0-a695-4e71-8b41-dcec59d2f830 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-20cd5bae-0883-43fd-9b6d-c0ceb23c3ea1 req-576d49d0-a695-4e71-8b41-dcec59d2f830 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:52 user nova-compute[73007]: WARNING nova.compute.manager [req-20cd5bae-0883-43fd-9b6d-c0ceb23c3ea1 req-576d49d0-a695-4e71-8b41-dcec59d2f830 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state building and task_state spawning.
Aug 15 17:52:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:52:53 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:52:53 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:52:53 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef125625-0503-4692-bf0c-7d35b399ebaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:52:53 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2571505d-c973-4f76-8cfe-faee7a1e56c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7] added
Aug 15 17:52:53 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b83c99-d09c-408d-b3d3-586d5d7b0c21]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1905b523-3b4f-45c9-bc03-1c70770cc612]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElhGBiqR {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElhGBiqR" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa29bbc8-79c1-40fe-bcb0-a23808632108]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ElhGBiqR'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e094d-805f-4f48-8ec3-6c9bf85c3e31]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a307cc8-3cc2-46b8-8d28-a386407d3753]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:52:53 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:52:53 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fad455-3e3b-4413-be69-40062298baa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]
Aug 15 17:52:53 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.
Aug 15 17:52:53 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[256a023d-f316-488d-b1f3-9acb99daead7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d313f7-8b50-44c2-a8a5-483a79201507]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:52:53 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:52:53 user nova-compute[73007]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:52:53 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa9cc1c-d5d6-4cae-a2b2-43464e8d48d5]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:52:53 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121974.4482932, c8047564-c2ee-43f4-b423-cc9c686eabc1 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:54 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] VM Resumed (Lifecycle Event)
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:52:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance spawned successfully.
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:52:54 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121974.4503632, c8047564-c2ee-43f4-b423-cc9c686eabc1 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:54 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] VM Started (Lifecycle Event)
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:52:54 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:52:54 user nova-compute[73007]: INFO nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:54 user nova-compute[73007]: INFO nova.compute.manager [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Took 21.23 seconds to build instance.
Aug 15 17:52:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec3795c0-be12-44d7-9163-669dcf943368 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.328s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-ef4414c8-5844-4eda-ae3e-775d53327216 req-6ae3aebe-3bc3-4f0b-a148-081695ccf879 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ef4414c8-5844-4eda-ae3e-775d53327216 req-6ae3aebe-3bc3-4f0b-a148-081695ccf879 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ef4414c8-5844-4eda-ae3e-775d53327216 req-6ae3aebe-3bc3-4f0b-a148-081695ccf879 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ef4414c8-5844-4eda-ae3e-775d53327216 req-6ae3aebe-3bc3-4f0b-a148-081695ccf879 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-ef4414c8-5844-4eda-ae3e-775d53327216 req-6ae3aebe-3bc3-4f0b-a148-081695ccf879 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:54 user nova-compute[73007]: WARNING nova.compute.manager [req-ef4414c8-5844-4eda-ae3e-775d53327216 req-6ae3aebe-3bc3-4f0b-a148-081695ccf879 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state active and task_state None.
Aug 15 17:52:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26536666463396439', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536666463396439', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.objects.instance [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'flavor' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:52:54 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:52:54 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 17:52:54 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:52:54 user nova-compute[73007]:   <serial>8f4a21dd-e2fe-4302-beb7-ec9a094317f7</serial>
Aug 15 17:52:54 user nova-compute[73007]: </disk>
Aug 15 17:52:54 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:52:55 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:52:55 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:52:55 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] No VIF found with MAC fa:16:3e:95:7c:d9, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:52:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0dcb2207-d1b5-4b58-9504-921256825b9b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.852s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Stashing vm_state: active {{(pid=73007) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.objects.instance [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'pci_requests' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:52:58 user nova-compute[73007]: INFO nova.compute.claims [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Claim successful on node user
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.objects.instance [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'resources' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.objects.instance [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:52:58 user nova-compute[73007]: INFO nova.compute.resource_tracker [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating resource usage from migration 92c9d9f0-f763-4c05-a6bb-bd2a6dcf26e5
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.504s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:58 user nova-compute[73007]: INFO nova.compute.manager [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Migrating
Aug 15 17:52:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:58 user nova-compute[73007]: INFO nova.compute.rpcapi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 17:52:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121963.5316582, 70146485-1eef-4e98-88d3-01f14133c3f7 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:52:58 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] VM Stopped (Lifecycle Event)
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4b8d492b-a432-4677-8692-e48adaedd0fe None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:52:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Starting migrate_disk_and_power_off {{(pid=73007) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-5de01b0b-d13f-4533-b12a-92a4716677f6 req-8444a955-6a6a-4166-a468-81477e5cd5d3 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5de01b0b-d13f-4533-b12a-92a4716677f6 req-8444a955-6a6a-4166-a468-81477e5cd5d3 service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5de01b0b-d13f-4533-b12a-92a4716677f6 req-8444a955-6a6a-4166-a468-81477e5cd5d3 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5de01b0b-d13f-4533-b12a-92a4716677f6 req-8444a955-6a6a-4166-a468-81477e5cd5d3 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:52:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-5de01b0b-d13f-4533-b12a-92a4716677f6 req-8444a955-6a6a-4166-a468-81477e5cd5d3 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:52:59 user nova-compute[73007]: WARNING nova.compute.manager [req-5de01b0b-d13f-4533-b12a-92a4716677f6 req-8444a955-6a6a-4166-a468-81477e5cd5d3 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state active and task_state resize_migrating.
Aug 15 17:53:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance destroyed successfully.
Aug 15 17:53:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1361397922-network", "vif_mac": "fa:16:3e:95:7c:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1361397922-network", "vif_mac": "fa:16:3e:95:7c:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_vif [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89f9df72-56, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:00 user nova-compute[73007]: INFO os_vif [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56')
Aug 15 17:53:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:53:00 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cd15e0-2d8b-48aa-8e8e-18e51c43c8fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2b055f-e225-4071-a969-8d7e0abb159e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:53:00 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:00 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:00 user nova-compute[73007]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:53:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:53:00 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:00 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:00 user nova-compute[73007]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:53:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c68f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb507d8-7d2b-4859-8734-f3ceda974df7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e2fb36-018e-4f5a-afaa-a95069bb735e]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa0824-25f7-4668-aa8f-50f873d224ba]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8278fdd-d69e-45ad-9a25-35b7b6404bea]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae36e2f-a585-450e-9404-d99141d7c515]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4990ce7f-e00c-4244-8c59-89701d05a11a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]
Aug 15 17:53:00 user nova-compute[73007]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.
Aug 15 17:53:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f3fe4e-72ad-49f0-9633-09efa4595fa0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== disconnect_volume: return (293ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:53:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344_resize/disk /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "cp -r /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344_resize/disk /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk" returned: 0 in 0.504s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344_resize/disk.info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk.info {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "cp -r /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344_resize/disk.info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk.info" returned: 0 in 0.035s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:01 user nova-compute[73007]: DEBUG nova.compute.manager [req-e0c0d376-fab3-4773-8080-7a2264a712b0 req-6727cf14-a208-43e4-bce6-ce4c28f2690d service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e0c0d376-fab3-4773-8080-7a2264a712b0 req-6727cf14-a208-43e4-bce6-ce4c28f2690d service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e0c0d376-fab3-4773-8080-7a2264a712b0 req-6727cf14-a208-43e4-bce6-ce4c28f2690d service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e0c0d376-fab3-4773-8080-7a2264a712b0 req-6727cf14-a208-43e4-bce6-ce4c28f2690d service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:01 user nova-compute[73007]: DEBUG nova.compute.manager [req-e0c0d376-fab3-4773-8080-7a2264a712b0 req-6727cf14-a208-43e4-bce6-ce4c28f2690d service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:01 user nova-compute[73007]: WARNING nova.compute.manager [req-e0c0d376-fab3-4773-8080-7a2264a712b0 req-6727cf14-a208-43e4-bce6-ce4c28f2690d service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state active and task_state resize_migrating.
Aug 15 17:53:02 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Port 89f9df72-5653-4107-9de4-9919b16b7f17 binding to destination host user is already ACTIVE {{(pid=73007) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:02 user nova-compute[73007]: INFO nova.compute.manager [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Terminating instance
Aug 15 17:53:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-fb4d2561-d0c2-4254-a874-3979d0fd0fa0 req-19472b09-e449-4665-8980-543a935dfb91 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fb4d2561-d0c2-4254-a874-3979d0fd0fa0 req-19472b09-e449-4665-8980-543a935dfb91 service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fb4d2561-d0c2-4254-a874-3979d0fd0fa0 req-19472b09-e449-4665-8980-543a935dfb91 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fb4d2561-d0c2-4254-a874-3979d0fd0fa0 req-19472b09-e449-4665-8980-543a935dfb91 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-fb4d2561-d0c2-4254-a874-3979d0fd0fa0 req-19472b09-e449-4665-8980-543a935dfb91 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-fb4d2561-d0c2-4254-a874-3979d0fd0fa0 req-19472b09-e449-4665-8980-543a935dfb91 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-unplugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:53:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Instance destroyed successfully.
Aug 15 17:53:03 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'resources' on Instance uuid 42c38120-5e1d-4438-a53b-8a188e417c91 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553936509',display_name='tempest-AttachVolumeTestJSON-server-1553936509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553936509',id=4,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxGZYng1+JPTUOS8sTyZYTcAO9cBipyZWoWRYLYe01C1uH7UwXAvLOGcVTVhHLZgbHfLTWmK67mHPnfTIP6g2mNqBpHJlp+7FXm36bYKlIQBBtiZLVCEu4GIPv04x3rnQ==',key_name='tempest-keypair-353257920',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-frf3c23s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=42c38120-5e1d-4438-a53b-8a188e417c91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "2c926c8a-890e-40cf-b2c4-906f890e4791", "address": "fa:16:3e:4c:f4:0a", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c926c8a-89", "ovs_interfaceid": "2c926c8a-890e-40cf-b2c4-906f890e4791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG os_vif [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c926c8a-89, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:03 user nova-compute[73007]: INFO os_vif [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:f4:0a,bridge_name='br-int',has_traffic_filtering=True,id=2c926c8a-890e-40cf-b2c4-906f890e4791,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c926c8a-89')
Aug 15 17:53:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Deleting instance files /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91_del
Aug 15 17:53:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Deletion of /opt/stack/data/nova/instances/42c38120-5e1d-4438-a53b-8a188e417c91_del complete
Aug 15 17:53:03 user nova-compute[73007]: DEBUG os_brick.utils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[735e199a-97d5-488e-aedf-fda798582a9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff8ac7d-092e-42f2-a90f-f962fa34636c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:03 user nova-compute[73007]: INFO nova.compute.manager [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3721820-2a67-42ad-bc90-d98148d3e045]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acd657d-7d6a-4c95-8580-180cc6c2762f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:53:03 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:53:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0e2737-89f2-493a-abdf-b7d9fb870218]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:53:03 user nova-compute[73007]: DEBUG os_brick.utils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:53:04 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:04 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Took 1.01 seconds to deallocate network for instance.
Aug 15 17:53:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ea6f540-4f78-4818-a184-1a4a71367901 req-442df0c6-5781-4215-ad04-24e9aa54b245 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-deleted-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:04 user nova-compute[73007]: INFO nova.compute.manager [req-1ea6f540-4f78-4818-a184-1a4a71367901 req-442df0c6-5781-4215-ad04-24e9aa54b245 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Neutron deleted interface 2c926c8a-890e-40cf-b2c4-906f890e4791; detaching it from the instance and deleting it from the info cache
Aug 15 17:53:04 user nova-compute[73007]: DEBUG nova.network.neutron [req-1ea6f540-4f78-4818-a184-1a4a71367901 req-442df0c6-5781-4215-ad04-24e9aa54b245 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-1ea6f540-4f78-4818-a184-1a4a71367901 req-442df0c6-5781-4215-ad04-24e9aa54b245 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Detach interface failed, port_id=2c926c8a-890e-40cf-b2c4-906f890e4791, reason: Instance 42c38120-5e1d-4438-a53b-8a188e417c91 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:53:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:04 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:53:04 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:53:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-a7cfbaf7-9a19-471f-a176-92c82cb32c9c req-a52e25c8-6cad-4371-b1a0-85ffd854c582 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a7cfbaf7-9a19-471f-a176-92c82cb32c9c req-a52e25c8-6cad-4371-b1a0-85ffd854c582 service nova] Acquiring lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a7cfbaf7-9a19-471f-a176-92c82cb32c9c req-a52e25c8-6cad-4371-b1a0-85ffd854c582 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a7cfbaf7-9a19-471f-a176-92c82cb32c9c req-a52e25c8-6cad-4371-b1a0-85ffd854c582 service nova] Lock "42c38120-5e1d-4438-a53b-8a188e417c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-a7cfbaf7-9a19-471f-a176-92c82cb32c9c req-a52e25c8-6cad-4371-b1a0-85ffd854c582 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] No waiting events found dispatching network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:05 user nova-compute[73007]: WARNING nova.compute.manager [req-a7cfbaf7-9a19-471f-a176-92c82cb32c9c req-a52e25c8-6cad-4371-b1a0-85ffd854c582 service nova] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Received unexpected event network-vif-plugged-2c926c8a-890e-40cf-b2c4-906f890e4791 for instance with vm_state deleted and task_state None.
Aug 15 17:53:05 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Deleted allocations for instance 42c38120-5e1d-4438-a53b-8a188e417c91
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:05 user nova-compute[73007]: INFO nova.compute.manager [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Terminating instance
Aug 15 17:53:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ec0b2e8c-5a3f-4ccb-a3df-af5957f1904b tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "42c38120-5e1d-4438-a53b-8a188e417c91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.873s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:05 user nova-compute[73007]: INFO nova.compute.manager [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Terminating instance
Aug 15 17:53:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-b0ffdd4c-f76f-4230-ab40-1868fdceb964 req-7d34baf8-99d8-4324-9618-f989f023af97 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received event network-vif-unplugged-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b0ffdd4c-f76f-4230-ab40-1868fdceb964 req-7d34baf8-99d8-4324-9618-f989f023af97 service nova] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b0ffdd4c-f76f-4230-ab40-1868fdceb964 req-7d34baf8-99d8-4324-9618-f989f023af97 service nova] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b0ffdd4c-f76f-4230-ab40-1868fdceb964 req-7d34baf8-99d8-4324-9618-f989f023af97 service nova] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-b0ffdd4c-f76f-4230-ab40-1868fdceb964 req-7d34baf8-99d8-4324-9618-f989f023af97 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] No waiting events found dispatching network-vif-unplugged-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-b0ffdd4c-f76f-4230-ab40-1868fdceb964 req-7d34baf8-99d8-4324-9618-f989f023af97 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received event network-vif-unplugged-6510aa47-8337-470f-bf79-62a651835537 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:53:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Instance destroyed successfully.
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'resources' on Instance uuid eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1021287927',display_name='tempest-AttachVolumeNegativeTest-server-1021287927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1021287927',id=22,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBYTjTo1YUPIP+SfbbllpHnABDT4o3XQ7M6PaaVHQi8d7SnZX3eMUUiLCW0CXw1kRd20gTozUH4VX53aHKTUnq/C/mG18cs5Ftjmjk4OS4pOrYAqobqQBjoZRJ37fpn2Q==',key_name='tempest-keypair-1804934813',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-tv1ehvml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "6510aa47-8337-470f-bf79-62a651835537", "address": "fa:16:3e:e5:48:83", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510aa47-83", "ovs_interfaceid": "6510aa47-8337-470f-bf79-62a651835537", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:48:83,bridge_name='br-int',has_traffic_filtering=True,id=6510aa47-8337-470f-bf79-62a651835537,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510aa47-83') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_vif [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:48:83,bridge_name='br-int',has_traffic_filtering=True,id=6510aa47-8337-470f-bf79-62a651835537,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510aa47-83') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6510aa47-83, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Instance destroyed successfully.
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'resources' on Instance uuid 81fc8cd9-5759-4d17-9ff5-6e1c249d376f {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: INFO os_vif [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:48:83,bridge_name='br-int',has_traffic_filtering=True,id=6510aa47-8337-470f-bf79-62a651835537,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510aa47-83')
Aug 15 17:53:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Deleting instance files /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a_del
Aug 15 17:53:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Deletion of /opt/stack/data/nova/instances/eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a_del complete
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1851150820',display_name='tempest-TestVolumeBootPattern-server-1851150820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1851150820',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:51:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-xcovy1e9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:51:41Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=81fc8cd9-5759-4d17-9ff5-6e1c249d376f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "c818c292-4339-41d2-8455-a57a05f49e89", "address": "fa:16:3e:bc:ff:f0", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc818c292-43", "ovs_interfaceid": "c818c292-4339-41d2-8455-a57a05f49e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ff:f0,bridge_name='br-int',has_traffic_filtering=True,id=c818c292-4339-41d2-8455-a57a05f49e89,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc818c292-43') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_vif [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ff:f0,bridge_name='br-int',has_traffic_filtering=True,id=c818c292-4339-41d2-8455-a57a05f49e89,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc818c292-43') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc818c292-43, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:53:06 user nova-compute[73007]: INFO os_vif [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:ff:f0,bridge_name='br-int',has_traffic_filtering=True,id=c818c292-4339-41d2-8455-a57a05f49e89,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc818c292-43')
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMEkvCfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:53:06 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83f3150-64fb-4afe-9d64-db8b76f00b23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16aec0f-6f52-4cd2-b8ce-dc59542228ae]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:53:06 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:06 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d (non-flash)
Aug 15 17:53:06 user nova-compute[73007]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:06 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11507cfe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4282551-cd87-475f-832a-c26d100d9315]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: INFO nova.compute.manager [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc2ba3b-da85-4df4-a6d7-0457daed760b]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[802166e6-cb10-44ca-bb34-5a85a121301b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37e8c8-395b-435e-87b6-78cfefa12113]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb473cbc-f2a9-4e04-bc07-936f45ecae29]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5486506-5557-4778-9ffb-1737e8e58786]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d, portal: 172.16.0.220,3260]
Aug 15 17:53:06 user nova-compute[73007]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d, portal: 172.16.0.220,3260] successful.
Aug 15 17:53:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b565a9-aa3b-4930-b306-a66bb7cdd83d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b7c817-231a-4120-9d71-444208989a43]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== disconnect_volume: return (341ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:53:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Deleting instance files /opt/stack/data/nova/instances/81fc8cd9-5759-4d17-9ff5-6e1c249d376f_del
Aug 15 17:53:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Deletion of /opt/stack/data/nova/instances/81fc8cd9-5759-4d17-9ff5-6e1c249d376f_del complete
Aug 15 17:53:06 user nova-compute[73007]: INFO nova.compute.manager [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Took 1.52 seconds to destroy the instance on the hypervisor.
Aug 15 17:53:06 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received event network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Acquiring lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] No waiting events found dispatching network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:07 user nova-compute[73007]: WARNING nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received unexpected event network-vif-plugged-6510aa47-8337-470f-bf79-62a651835537 for instance with vm_state active and task_state deleting.
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-unplugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] No waiting events found dispatching network-vif-unplugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-unplugged-c818c292-4339-41d2-8455-a57a05f49e89 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] No waiting events found dispatching network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:07 user nova-compute[73007]: WARNING nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received unexpected event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 for instance with vm_state active and task_state deleting.
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] No waiting events found dispatching network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:07 user nova-compute[73007]: WARNING nova.compute.manager [req-cf7a4279-a1a0-4191-b967-bf2352b9f103 req-86ba04e4-740b-491d-8ff6-cdb80fd90126 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received unexpected event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 for instance with vm_state active and task_state deleting.
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:07 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Took 1.12 seconds to deallocate network for instance.
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-baf018b4-8a0e-40ca-b375-a8fc7e86b823 req-66804d86-d6bb-4985-895c-9ed138ebf42e service nova] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Received event network-vif-deleted-6510aa47-8337-470f-bf79-62a651835537 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:07 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:07 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Took 1.03 seconds to deallocate network for instance.
Aug 15 17:53:08 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:53:08 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:53:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:08 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Deleted allocations for instance eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a
Aug 15 17:53:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1e654eee-c470-45b8-ba83-4b7e384a9671 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.069s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:08 user nova-compute[73007]: INFO nova.compute.manager [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Took 0.78 seconds to detach 1 volumes for instance.
Aug 15 17:53:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Deleting volume: 69b565a9-aa3b-4930-b306-a66bb7cdd83d {{(pid=73007) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 17:53:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:09 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Deleted allocations for instance 81fc8cd9-5759-4d17-9ff5-6e1c249d376f
Aug 15 17:53:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1cd785a3-eb7f-4834-bfd2-5104b74fce40 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.017s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] No waiting events found dispatching network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:09 user nova-compute[73007]: WARNING nova.compute.manager [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received unexpected event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 for instance with vm_state deleted and task_state None.
Aug 15 17:53:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] Acquiring lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] Lock "81fc8cd9-5759-4d17-9ff5-6e1c249d376f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] No waiting events found dispatching network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:09 user nova-compute[73007]: WARNING nova.compute.manager [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received unexpected event network-vif-plugged-c818c292-4339-41d2-8455-a57a05f49e89 for instance with vm_state deleted and task_state None.
Aug 15 17:53:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e6e6822f-6792-43c4-b27a-b8926f7dc9e8 req-f9b3a627-76c8-4053-917f-82fed14060d4 service nova] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Received event network-vif-deleted-c818c292-4339-41d2-8455-a57a05f49e89 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Starting finish_migration {{(pid=73007) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance directory exists: not creating {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 17:53:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Creating image(s)
Aug 15 17:53:13 user nova-compute[73007]: DEBUG nova.objects.instance [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.177s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk. size=21474836480 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk 21474836480 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk 21474836480" returned: 0 in 0.068s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Ensure instance console log exists: /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Start _get_guest_xml network_info=[{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1361397922-network", "vif_mac": "fa:16:3e:95:7c:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8b23c7bd-e243-4e1d-b88a-e394e3191344', 'attached_at': '2023-08-15T17:53:13.000000', 'detached_at': '', 'volume_id': '8f4a21dd-e2fe-4302-beb7-ec9a094317f7', 'serial': '8f4a21dd-e2fe-4302-beb7-ec9a094317f7'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '39b9d8e3-03a8-4d9f-80b5-af76f5bcfaf2', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:53:14 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:53:14 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.objects.instance [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:53:14 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:53:14 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:53:14 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[915a9919-9a29-4912-baa2-bda746bd0834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:53:14 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[67866e32-48cb-4cdb-bb34-2c39b5ccca8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7] added
Aug 15 17:53:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[718ae552-e0b4-4018-a2ab-32bfd532b579]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91d7cf0-a795-438c-afc7-2b658a55de06]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElhGBiqR {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElhGBiqR" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f632057-c911-4743-aa68-9f117fb7a079]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ElhGBiqR'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[231b428e-fbb4-4f7e-90ee-5320923ec17c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea84a3e4-7721-4796-8cd4-47d450edc408]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:14 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:14 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e3831c-3000-4091-b961-e3bc61846bce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]
Aug 15 17:53:14 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.
Aug 15 17:53:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dbbc42-7abc-44d0-95b8-9ce1b2ced753]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f5c65-4981-4619-825d-6a0c18ca9a2d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:14 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:14 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:53:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:14 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:14 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:53:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d84b2-c71b-450c-934b-f13aa7f20cc4]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121980.0140567, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:15 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Stopped (Lifecycle Event)
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4a4132b2-375e-47e2-8544-dcf2639897b7 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4a4132b2-375e-47e2-8544-dcf2639897b7 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:15 user nova-compute[73007]: INFO nova.compute.manager [None req-4a4132b2-375e-47e2-8544-dcf2639897b7 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26536666463396439', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536666463396439', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1361397922-network", "vif_mac": "fa:16:3e:95:7c:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1361397922-network", "vif_mac": "fa:16:3e:95:7c:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:53:15 user nova-compute[73007]:   <uuid>8b23c7bd-e243-4e1d-b88a-e394e3191344</uuid>
Aug 15 17:53:15 user nova-compute[73007]:   <name>instance-00000011</name>
Aug 15 17:53:15 user nova-compute[73007]:   <memory>2097152</memory>
Aug 15 17:53:15 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:53:15 user nova-compute[73007]:   <metadata>
Aug 15 17:53:15 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:53:15 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:53:15 user nova-compute[73007]:       <nova:name>tempest-ServerActionsTestOtherB-server-1486128635</nova:name>
Aug 15 17:53:15 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:53:14</nova:creationTime>
Aug 15 17:53:15 user nova-compute[73007]:       <nova:flavor name="m1.small">
Aug 15 17:53:15 user nova-compute[73007]:         <nova:memory>2048</nova:memory>
Aug 15 17:53:15 user nova-compute[73007]:         <nova:disk>20</nova:disk>
Aug 15 17:53:15 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:53:15 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:53:15 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:53:15 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:53:15 user nova-compute[73007]:       <nova:owner>
Aug 15 17:53:15 user nova-compute[73007]:         <nova:user uuid="c04d1f1310ec43aa9b4f500267105f1d">tempest-ServerActionsTestOtherB-604941371-project-member</nova:user>
Aug 15 17:53:15 user nova-compute[73007]:         <nova:project uuid="3d1bc8ca5f444b73ae2ccf1c29c9dee3">tempest-ServerActionsTestOtherB-604941371</nova:project>
Aug 15 17:53:15 user nova-compute[73007]:       </nova:owner>
Aug 15 17:53:15 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:53:15 user nova-compute[73007]:       <nova:ports>
Aug 15 17:53:15 user nova-compute[73007]:         <nova:port uuid="89f9df72-5653-4107-9de4-9919b16b7f17">
Aug 15 17:53:15 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 17:53:15 user nova-compute[73007]:         </nova:port>
Aug 15 17:53:15 user nova-compute[73007]:       </nova:ports>
Aug 15 17:53:15 user nova-compute[73007]:     </nova:instance>
Aug 15 17:53:15 user nova-compute[73007]:   </metadata>
Aug 15 17:53:15 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:53:15 user nova-compute[73007]:     <system>
Aug 15 17:53:15 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:53:15 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:53:15 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:53:15 user nova-compute[73007]:       <entry name="serial">8b23c7bd-e243-4e1d-b88a-e394e3191344</entry>
Aug 15 17:53:15 user nova-compute[73007]:       <entry name="uuid">8b23c7bd-e243-4e1d-b88a-e394e3191344</entry>
Aug 15 17:53:15 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:53:15 user nova-compute[73007]:     </system>
Aug 15 17:53:15 user nova-compute[73007]:   </sysinfo>
Aug 15 17:53:15 user nova-compute[73007]:   <os>
Aug 15 17:53:15 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:53:15 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:53:15 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:53:15 user nova-compute[73007]:   </os>
Aug 15 17:53:15 user nova-compute[73007]:   <features>
Aug 15 17:53:15 user nova-compute[73007]:     <acpi/>
Aug 15 17:53:15 user nova-compute[73007]:     <apic/>
Aug 15 17:53:15 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:53:15 user nova-compute[73007]:   </features>
Aug 15 17:53:15 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:53:15 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:53:15 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:53:15 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:53:15 user nova-compute[73007]:   </clock>
Aug 15 17:53:15 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:53:15 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:53:15 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:53:15 user nova-compute[73007]:   </cpu>
Aug 15 17:53:15 user nova-compute[73007]:   <devices>
Aug 15 17:53:15 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:53:15 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:53:15 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk"/>
Aug 15 17:53:15 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:53:15 user nova-compute[73007]:     </disk>
Aug 15 17:53:15 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:53:15 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:53:15 user nova-compute[73007]:       <source dev="/dev/sdd"/>
Aug 15 17:53:15 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:53:15 user nova-compute[73007]:       <serial>8f4a21dd-e2fe-4302-beb7-ec9a094317f7</serial>
Aug 15 17:53:15 user nova-compute[73007]:     </disk>
Aug 15 17:53:15 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:53:15 user nova-compute[73007]:       <mac address="fa:16:3e:95:7c:d9"/>
Aug 15 17:53:15 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:53:15 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:53:15 user nova-compute[73007]:       <target dev="tap89f9df72-56"/>
Aug 15 17:53:15 user nova-compute[73007]:     </interface>
Aug 15 17:53:15 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:53:15 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/console.log" append="off"/>
Aug 15 17:53:15 user nova-compute[73007]:     </serial>
Aug 15 17:53:15 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:53:15 user nova-compute[73007]:     <video>
Aug 15 17:53:15 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:53:15 user nova-compute[73007]:     </video>
Aug 15 17:53:15 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:53:15 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:53:15 user nova-compute[73007]:     </rng>
Aug 15 17:53:15 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:53:15 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:53:15 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:53:15 user nova-compute[73007]:     </memballoon>
Aug 15 17:53:15 user nova-compute[73007]:   </devices>
Aug 15 17:53:15 user nova-compute[73007]: </domain>
Aug 15 17:53:15 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1361397922-network", "vif_mac": "fa:16:3e:95:7c:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1361397922-network", "vif_mac": "fa:16:3e:95:7c:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG os_vif [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89f9df72-56, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89f9df72-56, col_values=(('external_ids', {'iface-id': '89f9df72-5653-4107-9de4-9919b16b7f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:7c:d9', 'vm-uuid': '8b23c7bd-e243-4e1d-b88a-e394e3191344'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:15 user nova-compute[73007]: INFO os_vif [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56')
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] No VIF found with MAC fa:16:3e:95:7c:d9, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121999.184065, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Resumed (Lifecycle Event)
Aug 15 17:53:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121983.1700096, 42c38120-5e1d-4438-a53b-8a188e417c91 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:19 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] VM Stopped (Lifecycle Event)
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-45e6e6f6-5d1c-4fd3-acdb-4058ce831ec7 req-8d714395-1014-46db-9095-96e2f0d8b18c service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45e6e6f6-5d1c-4fd3-acdb-4058ce831ec7 req-8d714395-1014-46db-9095-96e2f0d8b18c service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45e6e6f6-5d1c-4fd3-acdb-4058ce831ec7 req-8d714395-1014-46db-9095-96e2f0d8b18c service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45e6e6f6-5d1c-4fd3-acdb-4058ce831ec7 req-8d714395-1014-46db-9095-96e2f0d8b18c service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-45e6e6f6-5d1c-4fd3-acdb-4058ce831ec7 req-8d714395-1014-46db-9095-96e2f0d8b18c service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:19 user nova-compute[73007]: WARNING nova.compute.manager [req-45e6e6f6-5d1c-4fd3-acdb-4058ce831ec7 req-8d714395-1014-46db-9095-96e2f0d8b18c service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state active and task_state resize_finish.
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-b34829c3-b928-4f09-ab2f-d2ce84130a3a req-d28251fa-d9b9-4189-b7fa-2a2d4f5f3e5e service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b34829c3-b928-4f09-ab2f-d2ce84130a3a req-d28251fa-d9b9-4189-b7fa-2a2d4f5f3e5e service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b34829c3-b928-4f09-ab2f-d2ce84130a3a req-d28251fa-d9b9-4189-b7fa-2a2d4f5f3e5e service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b34829c3-b928-4f09-ab2f-d2ce84130a3a req-d28251fa-d9b9-4189-b7fa-2a2d4f5f3e5e service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-b34829c3-b928-4f09-ab2f-d2ce84130a3a req-d28251fa-d9b9-4189-b7fa-2a2d4f5f3e5e service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:19 user nova-compute[73007]: WARNING nova.compute.manager [req-b34829c3-b928-4f09-ab2f-d2ce84130a3a req-d28251fa-d9b9-4189-b7fa-2a2d4f5f3e5e service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state active and task_state resize_finish.
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance running successfully.
Aug 15 17:53:19 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:53:19 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7412MB free_disk=25.373443603515625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f660dffe-9c1a-46d6-b13e-262083beb86b None None] [instance: 42c38120-5e1d-4438-a53b-8a188e417c91] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Failed to set time: agent not configured {{(pid=73007) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-41a9e79d-7358-4eef-89c8-dc2198bc9c58 tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] finish_migration finished successfully. {{(pid=73007) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 17:53:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692121999.1848001, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Started (Lifecycle Event)
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:53:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Applying migration context for instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 as it has an incoming, in-progress migration 92c9d9f0-f763-4c05-a6bb-bd2a6dcf26e5. Migration status is finished {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 17:53:19 user nova-compute[73007]: INFO nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating resource usage from migration 92c9d9f0-f763-4c05-a6bb-bd2a6dcf26e5
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 35fd679b-f098-4905-aa23-1fce430265bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Migration 92c9d9f0-f763-4c05-a6bb-bd2a6dcf26e5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:53:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:53:20 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:53:20 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:53:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:53:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:21 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121986.2416909, eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:21 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] VM Stopped (Lifecycle Event)
Aug 15 17:53:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-470feac2-c30e-4090-9422-1faf5d40cb27 None None] [instance: eb1caf46-cea0-4ec9-b0d9-0f7e1a2f9d9a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:21 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692121986.2778707, 81fc8cd9-5759-4d17-9ff5-6e1c249d376f => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:21 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] VM Stopped (Lifecycle Event)
Aug 15 17:53:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7a9883af-f037-49f0-b37c-1b4e3768bb72 None None] [instance: 81fc8cd9-5759-4d17-9ff5-6e1c249d376f] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:25 user nova-compute[73007]: INFO nova.compute.manager [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Terminating instance
Aug 15 17:53:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-183b90cc-8e30-4908-a6b5-7debacfbed7d req-adf4d0db-5d58-4bca-8a4e-ed70d3c0c49d service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received event network-vif-unplugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-183b90cc-8e30-4908-a6b5-7debacfbed7d req-adf4d0db-5d58-4bca-8a4e-ed70d3c0c49d service nova] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-183b90cc-8e30-4908-a6b5-7debacfbed7d req-adf4d0db-5d58-4bca-8a4e-ed70d3c0c49d service nova] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-183b90cc-8e30-4908-a6b5-7debacfbed7d req-adf4d0db-5d58-4bca-8a4e-ed70d3c0c49d service nova] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-183b90cc-8e30-4908-a6b5-7debacfbed7d req-adf4d0db-5d58-4bca-8a4e-ed70d3c0c49d service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] No waiting events found dispatching network-vif-unplugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-183b90cc-8e30-4908-a6b5-7debacfbed7d req-adf4d0db-5d58-4bca-8a4e-ed70d3c0c49d service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received event network-vif-unplugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:53:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Instance destroyed successfully.
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lazy-loading 'resources' on Instance uuid 35fd679b-f098-4905-aa23-1fce430265bd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-297317215',display_name='tempest-TestServerVolumeAttachmentScenario-server-297317215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-297317215',id=18,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6514sJKOud2eQpssNcoMHinH9oWzFLTGqvnSXcq3TS9OBwylzZPw2c0OICszq/ygPE/T++v0K/KriHfQCnh8Xcgbpbfy9SyBa2KvLn8dksnTa4h/j947fXQvuIDIz/kg==',key_name='tempest-keypair-1148712899',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:49:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b524d83f2464f89b96d677820abbd2e',ramdisk_id='',reservation_id='r-9qtcq6nf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-573443537',owner_user_name='tempest-TestServerVolumeAttachmentScenario-573443537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4d214b17e13412ab2fb1b797816aa7a',uuid=35fd679b-f098-4905-aa23-1fce430265bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Converting VIF {"id": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "address": "fa:16:3e:8c:cb:95", "network": {"id": "47cb6677-09fa-4f83-82c9-a94ec4f2b7d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-415862502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b524d83f2464f89b96d677820abbd2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a0ba0fd-e6", "ovs_interfaceid": "9a0ba0fd-e69d-47c4-b71b-37286881a1a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=9a0ba0fd-e69d-47c4-b71b-37286881a1a3,network=Network(47cb6677-09fa-4f83-82c9-a94ec4f2b7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0ba0fd-e6') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG os_vif [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=9a0ba0fd-e69d-47c4-b71b-37286881a1a3,network=Network(47cb6677-09fa-4f83-82c9-a94ec4f2b7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0ba0fd-e6') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a0ba0fd-e6, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:53:26 user nova-compute[73007]: INFO os_vif [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:cb:95,bridge_name='br-int',has_traffic_filtering=True,id=9a0ba0fd-e69d-47c4-b71b-37286881a1a3,network=Network(47cb6677-09fa-4f83-82c9-a94ec4f2b7d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a0ba0fd-e6')
Aug 15 17:53:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Deleting instance files /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd_del
Aug 15 17:53:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Deletion of /opt/stack/data/nova/instances/35fd679b-f098-4905-aa23-1fce430265bd_del complete
Aug 15 17:53:26 user nova-compute[73007]: INFO nova.compute.manager [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 17:53:26 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:26 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Took 0.81 seconds to deallocate network for instance.
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-abdacf12-5fff-41c1-be4b-336759721679 req-5baecd92-866a-4b5c-8520-55467766d6cb service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received event network-vif-deleted-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:26 user nova-compute[73007]: INFO nova.compute.manager [req-abdacf12-5fff-41c1-be4b-336759721679 req-5baecd92-866a-4b5c-8520-55467766d6cb service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Neutron deleted interface 9a0ba0fd-e69d-47c4-b71b-37286881a1a3; detaching it from the instance and deleting it from the info cache
Aug 15 17:53:26 user nova-compute[73007]: DEBUG nova.network.neutron [req-abdacf12-5fff-41c1-be4b-336759721679 req-5baecd92-866a-4b5c-8520-55467766d6cb service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-abdacf12-5fff-41c1-be4b-336759721679 req-5baecd92-866a-4b5c-8520-55467766d6cb service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Detach interface failed, port_id=9a0ba0fd-e69d-47c4-b71b-37286881a1a3, reason: Instance 35fd679b-f098-4905-aa23-1fce430265bd could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:27 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Deleted allocations for instance 35fd679b-f098-4905-aa23-1fce430265bd
Aug 15 17:53:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ddf60976-4535-4115-bf4a-8b6f8edce37f tempest-TestServerVolumeAttachmentScenario-573443537 tempest-TestServerVolumeAttachmentScenario-573443537-project-member] Lock "35fd679b-f098-4905-aa23-1fce430265bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.277s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-60cc102a-5c58-436e-b4c3-211c3d1365e2 req-71bcdfca-3a48-42b1-8182-9179370728e9 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received event network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-60cc102a-5c58-436e-b4c3-211c3d1365e2 req-71bcdfca-3a48-42b1-8182-9179370728e9 service nova] Acquiring lock "35fd679b-f098-4905-aa23-1fce430265bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-60cc102a-5c58-436e-b4c3-211c3d1365e2 req-71bcdfca-3a48-42b1-8182-9179370728e9 service nova] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-60cc102a-5c58-436e-b4c3-211c3d1365e2 req-71bcdfca-3a48-42b1-8182-9179370728e9 service nova] Lock "35fd679b-f098-4905-aa23-1fce430265bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-60cc102a-5c58-436e-b4c3-211c3d1365e2 req-71bcdfca-3a48-42b1-8182-9179370728e9 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] No waiting events found dispatching network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:27 user nova-compute[73007]: WARNING nova.compute.manager [req-60cc102a-5c58-436e-b4c3-211c3d1365e2 req-71bcdfca-3a48-42b1-8182-9179370728e9 service nova] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Received unexpected event network-vif-plugged-9a0ba0fd-e69d-47c4-b71b-37286881a1a3 for instance with vm_state deleted and task_state None.
Aug 15 17:53:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-140b1014-735d-4aed-bbb5-fccc6cb62cb6 req-243086d3-ffa4-4ff9-bdb4-0b25df778f7c service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-changed-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:39 user nova-compute[73007]: DEBUG nova.compute.manager [req-140b1014-735d-4aed-bbb5-fccc6cb62cb6 req-243086d3-ffa4-4ff9-bdb4-0b25df778f7c service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Refreshing instance network info cache due to event network-changed-e8a4549a-52c9-4091-a515-2515a704233a. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:53:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-140b1014-735d-4aed-bbb5-fccc6cb62cb6 req-243086d3-ffa4-4ff9-bdb4-0b25df778f7c service nova] Acquiring lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:53:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-140b1014-735d-4aed-bbb5-fccc6cb62cb6 req-243086d3-ffa4-4ff9-bdb4-0b25df778f7c service nova] Acquired lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:53:39 user nova-compute[73007]: DEBUG nova.network.neutron [req-140b1014-735d-4aed-bbb5-fccc6cb62cb6 req-243086d3-ffa4-4ff9-bdb4-0b25df778f7c service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Refreshing network info cache for port e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:53:40 user nova-compute[73007]: DEBUG nova.network.neutron [req-140b1014-735d-4aed-bbb5-fccc6cb62cb6 req-243086d3-ffa4-4ff9-bdb4-0b25df778f7c service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updated VIF entry in instance network info cache for port e8a4549a-52c9-4091-a515-2515a704233a. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:53:40 user nova-compute[73007]: DEBUG nova.network.neutron [req-140b1014-735d-4aed-bbb5-fccc6cb62cb6 req-243086d3-ffa4-4ff9-bdb4-0b25df778f7c service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updating instance_info_cache with network_info: [{"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-140b1014-735d-4aed-bbb5-fccc6cb62cb6 req-243086d3-ffa4-4ff9-bdb4-0b25df778f7c service nova] Releasing lock "refresh_cache-e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:53:40 user nova-compute[73007]: INFO nova.compute.manager [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Rebuilding instance
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122006.04587, 35fd679b-f098-4905-aa23-1fce430265bd => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:41 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] VM Stopped (Lifecycle Event)
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5d9d369-cf01-4b66-a7fb-44331266cd30 None None] [instance: 35fd679b-f098-4905-aa23-1fce430265bd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lazy-loading 'pci_requests' on Instance uuid e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lazy-loading 'pci_devices' on Instance uuid e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lazy-loading 'resources' on Instance uuid e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lazy-loading 'migration_context' on Instance uuid e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73007) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-57c998b7-be0f-4a4f-80ab-3e0dd28090ba req-78c79db9-a96c-4e24-9ead-e6a4f62a23d9 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-57c998b7-be0f-4a4f-80ab-3e0dd28090ba req-78c79db9-a96c-4e24-9ead-e6a4f62a23d9 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-57c998b7-be0f-4a4f-80ab-3e0dd28090ba req-78c79db9-a96c-4e24-9ead-e6a4f62a23d9 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-57c998b7-be0f-4a4f-80ab-3e0dd28090ba req-78c79db9-a96c-4e24-9ead-e6a4f62a23d9 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-57c998b7-be0f-4a4f-80ab-3e0dd28090ba req-78c79db9-a96c-4e24-9ead-e6a4f62a23d9 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:41 user nova-compute[73007]: WARNING nova.compute.manager [req-57c998b7-be0f-4a4f-80ab-3e0dd28090ba req-78c79db9-a96c-4e24-9ead-e6a4f62a23d9 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state rebuilding.
Aug 15 17:53:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance destroyed successfully.
Aug 15 17:53:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance destroyed successfully.
Aug 15 17:53:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1318095534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1935026486',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIvgMz7mYpX7D05Wb4MZinjT0gPxrata4a0MrGnRjy415APQIOBp9A9kgHgddReowFznukjRHIxc2JaK1t+GuWtb14Fs3FEJXbWoBXhofsNDiEYHbnLbLukZFbdXs0nXg==',key_name='tempest-keypair-1261262527',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ee8ba5df700457f9f97355fd864bece',ramdisk_id='',reservation_id='r-qcdh0wm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1292950819',owner_user_name='tempest-ServerActionsV293TestJSON-1292950819-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:53:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de582a0433c424c8f7f76d74b9abe09',uuid=e6bc8143-ca4e-40cb-a38d-0a1caec7eb61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converting VIF {"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_vif [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8a4549a-52, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: INFO os_vif [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52')
Aug 15 17:53:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:53:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.052s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a16019c-4968-4bb7-9dbf-a2427cc0b1e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b050526-e229-47d9-b7fa-70569bbb1e98]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:42 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:42 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:53:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:53:42 user nova-compute[73007]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:42 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:53:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11507bbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4731bc1b-41fe-46c4-b241-6c705dd19fa3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd349bb-5b65-450b-b553-a663126c5698]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbe569f-f37f-4309-9883-d125bdf8d5e1]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e4d31-a572-44ee-bab2-d1f1d6e41baf]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad33af4-05cb-48d9-911b-7ff51ab865a8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dcecea-9454-43db-a8c4-5ceee9eda171]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260]
Aug 15 17:53:42 user nova-compute[73007]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260] successful.
Aug 15 17:53:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7d2215-6e3e-4949-8b2c-d1f13fd29408]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] <== disconnect_volume: return (399ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:53:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Deleting instance files /opt/stack/data/nova/instances/e6bc8143-ca4e-40cb-a38d-0a1caec7eb61_del
Aug 15 17:53:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Deletion of /opt/stack/data/nova/instances/e6bc8143-ca4e-40cb-a38d-0a1caec7eb61_del complete
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 could not be found.
Aug 15 17:53:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:53:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:53:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4734da64-dbc7-43df-b3bb-a07882f6fa32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d7b28-34ca-4681-9fbc-2db58552f06e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:43 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:53:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:53:43 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:53:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c64a710>, {}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Disconnecting from: [] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] <== disconnect_volume: return (59ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:43 user nova-compute[73007]: WARNING nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state rebuilding.
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:43 user nova-compute[73007]: WARNING nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state rebuilding.
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:43 user nova-compute[73007]: WARNING nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state rebuilding.
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:43 user nova-compute[73007]: WARNING nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state rebuilding.
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:43 user nova-compute[73007]: WARNING nova.compute.manager [req-edbbc683-ed0f-49f6-99f4-729ef48ce0c6 req-e5986ec8-a38e-429a-b340-d4dede037d99 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state rebuilding.
Aug 15 17:53:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Preparing to wait for external event volume-reimaged-8e090ef5-d29e-43bf-8295-960b3b25b00b {{(pid=73007) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:47 user nova-compute[73007]: INFO nova.compute.manager [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Rescuing
Aug 15 17:53:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:53:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquired lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:53:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:53:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Updating instance_info_cache with network_info: [{"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:53:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Releasing lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-804a4094-dd5e-4f20-9375-a6268254b4d4 req-68b44e47-0dfe-4e31-9404-edd39fe4616b service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-unplugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-804a4094-dd5e-4f20-9375-a6268254b4d4 req-68b44e47-0dfe-4e31-9404-edd39fe4616b service nova] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-804a4094-dd5e-4f20-9375-a6268254b4d4 req-68b44e47-0dfe-4e31-9404-edd39fe4616b service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-804a4094-dd5e-4f20-9375-a6268254b4d4 req-68b44e47-0dfe-4e31-9404-edd39fe4616b service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-804a4094-dd5e-4f20-9375-a6268254b4d4 req-68b44e47-0dfe-4e31-9404-edd39fe4616b service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] No waiting events found dispatching network-vif-unplugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:48 user nova-compute[73007]: WARNING nova.compute.manager [req-804a4094-dd5e-4f20-9375-a6268254b4d4 req-68b44e47-0dfe-4e31-9404-edd39fe4616b service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received unexpected event network-vif-unplugged-d0452311-67f5-4735-b13c-a468d4b75e2d for instance with vm_state active and task_state rescuing.
Aug 15 17:53:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Instance destroyed successfully.
Aug 15 17:53:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Attempting rescue
Aug 15 17:53:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73007) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Instance directory exists: not creating {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 17:53:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Creating image(s)
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'trusted_certs' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.220s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue" returned: 0 in 0.048s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'migration_context' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Start _get_guest_xml network_info=[{"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:70:ce:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'resources' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'numa_topology' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:49 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:53:49 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1509921233',display_name='tempest-ServerRescueNegativeTestJSON-server-1509921233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1509921233',id=28,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-nsttvj8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:52:07Z,user_data=None,user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=d9648621-6b91-4028-9f89-83302bc7a8cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:70:ce:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:70:ce:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:ce:c8,bridge_name='br-int',has_traffic_filtering=True,id=d0452311-67f5-4735-b13c-a468d4b75e2d,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0452311-67') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'pci_devices' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:53:49 user nova-compute[73007]:   <uuid>d9648621-6b91-4028-9f89-83302bc7a8cd</uuid>
Aug 15 17:53:49 user nova-compute[73007]:   <name>instance-0000001c</name>
Aug 15 17:53:49 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:53:49 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:53:49 user nova-compute[73007]:   <metadata>
Aug 15 17:53:49 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:53:49 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:53:49 user nova-compute[73007]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1509921233</nova:name>
Aug 15 17:53:49 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:53:49</nova:creationTime>
Aug 15 17:53:49 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:53:49 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:53:49 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:53:49 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:53:49 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:53:49 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:53:49 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:53:49 user nova-compute[73007]:       <nova:owner>
Aug 15 17:53:49 user nova-compute[73007]:         <nova:user uuid="f886ee6939504c4b9a406cedb9a65acc">tempest-ServerRescueNegativeTestJSON-1846740548-project-member</nova:user>
Aug 15 17:53:49 user nova-compute[73007]:         <nova:project uuid="8f94edb7a50c4e0e97ddc96c5c0028fc">tempest-ServerRescueNegativeTestJSON-1846740548</nova:project>
Aug 15 17:53:49 user nova-compute[73007]:       </nova:owner>
Aug 15 17:53:49 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:53:49 user nova-compute[73007]:       <nova:ports>
Aug 15 17:53:49 user nova-compute[73007]:         <nova:port uuid="d0452311-67f5-4735-b13c-a468d4b75e2d">
Aug 15 17:53:49 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:53:49 user nova-compute[73007]:         </nova:port>
Aug 15 17:53:49 user nova-compute[73007]:       </nova:ports>
Aug 15 17:53:49 user nova-compute[73007]:     </nova:instance>
Aug 15 17:53:49 user nova-compute[73007]:   </metadata>
Aug 15 17:53:49 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:53:49 user nova-compute[73007]:     <system>
Aug 15 17:53:49 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:53:49 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:53:49 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:53:49 user nova-compute[73007]:       <entry name="serial">d9648621-6b91-4028-9f89-83302bc7a8cd</entry>
Aug 15 17:53:49 user nova-compute[73007]:       <entry name="uuid">d9648621-6b91-4028-9f89-83302bc7a8cd</entry>
Aug 15 17:53:49 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:53:49 user nova-compute[73007]:     </system>
Aug 15 17:53:49 user nova-compute[73007]:   </sysinfo>
Aug 15 17:53:49 user nova-compute[73007]:   <os>
Aug 15 17:53:49 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:53:49 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:53:49 user nova-compute[73007]:   </os>
Aug 15 17:53:49 user nova-compute[73007]:   <features>
Aug 15 17:53:49 user nova-compute[73007]:     <acpi/>
Aug 15 17:53:49 user nova-compute[73007]:     <apic/>
Aug 15 17:53:49 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:53:49 user nova-compute[73007]:   </features>
Aug 15 17:53:49 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:53:49 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:53:49 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:53:49 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:53:49 user nova-compute[73007]:   </clock>
Aug 15 17:53:49 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:53:49 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:53:49 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:53:49 user nova-compute[73007]:   </cpu>
Aug 15 17:53:49 user nova-compute[73007]:   <devices>
Aug 15 17:53:49 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:53:49 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:53:49 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue"/>
Aug 15 17:53:49 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:53:49 user nova-compute[73007]:     </disk>
Aug 15 17:53:49 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:53:49 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:53:49 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk"/>
Aug 15 17:53:49 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:53:49 user nova-compute[73007]:     </disk>
Aug 15 17:53:49 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:53:49 user nova-compute[73007]:       <mac address="fa:16:3e:70:ce:c8"/>
Aug 15 17:53:49 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:53:49 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:53:49 user nova-compute[73007]:       <target dev="tapd0452311-67"/>
Aug 15 17:53:49 user nova-compute[73007]:     </interface>
Aug 15 17:53:49 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:53:49 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/console.log" append="off"/>
Aug 15 17:53:49 user nova-compute[73007]:     </serial>
Aug 15 17:53:49 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:53:49 user nova-compute[73007]:     <video>
Aug 15 17:53:49 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:53:49 user nova-compute[73007]:     </video>
Aug 15 17:53:49 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:53:49 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:53:49 user nova-compute[73007]:     </rng>
Aug 15 17:53:49 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:53:49 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:53:49 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:53:49 user nova-compute[73007]:     </memballoon>
Aug 15 17:53:49 user nova-compute[73007]:   </devices>
Aug 15 17:53:49 user nova-compute[73007]: </domain>
Aug 15 17:53:49 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:53:49 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Instance destroyed successfully.
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:53:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No VIF found with MAC fa:16:3e:70:ce:c8, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-b013ec83-22dc-4230-b0b8-6205d522fc84 req-24e05a62-5de9-40b4-ae2a-3a9bb1c1d471 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b013ec83-22dc-4230-b0b8-6205d522fc84 req-24e05a62-5de9-40b4-ae2a-3a9bb1c1d471 service nova] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b013ec83-22dc-4230-b0b8-6205d522fc84 req-24e05a62-5de9-40b4-ae2a-3a9bb1c1d471 service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b013ec83-22dc-4230-b0b8-6205d522fc84 req-24e05a62-5de9-40b4-ae2a-3a9bb1c1d471 service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-b013ec83-22dc-4230-b0b8-6205d522fc84 req-24e05a62-5de9-40b4-ae2a-3a9bb1c1d471 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] No waiting events found dispatching network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:50 user nova-compute[73007]: WARNING nova.compute.manager [req-b013ec83-22dc-4230-b0b8-6205d522fc84 req-24e05a62-5de9-40b4-ae2a-3a9bb1c1d471 service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received unexpected event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d for instance with vm_state active and task_state rescuing.
Aug 15 17:53:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] No waiting events found dispatching network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:52 user nova-compute[73007]: WARNING nova.compute.manager [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received unexpected event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d for instance with vm_state active and task_state rescuing.
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] No waiting events found dispatching network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:53:52 user nova-compute[73007]: WARNING nova.compute.manager [req-9513cd34-7f1b-4632-a84b-dc7e86706d7f req-0e5287c4-cb5c-4b5d-9881-4d11f51f66cc service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received unexpected event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d for instance with vm_state active and task_state rescuing.
Aug 15 17:53:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for d9648621-6b91-4028-9f89-83302bc7a8cd due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122032.8440342, d9648621-6b91-4028-9f89-83302bc7a8cd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] VM Resumed (Lifecycle Event)
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1c735a29-c35a-48e1-8ef5-c1b752ef0bff tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:53:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122032.8470469, d9648621-6b91-4028-9f89-83302bc7a8cd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] VM Started (Lifecycle Event)
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:53:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 17:53:56 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122021.9946795, e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:53:56 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] VM Stopped (Lifecycle Event)
Aug 15 17:53:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-35119dc7-2484-4690-a771-42e28dbdf1de None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:53:57 user nova-compute[73007]: INFO nova.compute.claims [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Claim successful on node user
Aug 15 17:53:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:53:58 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:53:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG nova.policy [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1395246c93fc4c0dac8d95fffefd9711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1deb9da1fb54f8b8968f01265347c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:53:58 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Creating image(s)
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "/opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "/opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.249s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk 1073741824" returned: 0 in 0.059s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.246s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Successfully created port: 5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Cannot resize image /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'migration_context' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Ensure instance console log exists: /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:53:59 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:53:59 user nova-compute[73007]: INFO nova.compute.claims [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Claim successful on node user
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Successfully updated port: 5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquired lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-16d18aa7-29f3-4f6f-88da-067a485c6b51 req-15ab47c6-0c20-43cf-8d66-22f6d287bd7a service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received event network-changed-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-16d18aa7-29f3-4f6f-88da-067a485c6b51 req-15ab47c6-0c20-43cf-8d66-22f6d287bd7a service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Refreshing instance network info cache due to event network-changed-5540b31a-0158-4d93-a580-8b7c579e1d73. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-16d18aa7-29f3-4f6f-88da-067a485c6b51 req-15ab47c6-0c20-43cf-8d66-22f6d287bd7a service nova] Acquiring lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:54:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.policy [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82906484a46f4ad0be9a602aec2affb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfa702dd2884da4b28a84db913819b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:54:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Creating image(s)
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "/opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "/opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "/opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updating instance_info_cache with network_info: [{"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Releasing lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Instance network_info: |[{"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-16d18aa7-29f3-4f6f-88da-067a485c6b51 req-15ab47c6-0c20-43cf-8d66-22f6d287bd7a service nova] Acquired lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.neutron [req-16d18aa7-29f3-4f6f-88da-067a485c6b51 req-15ab47c6-0c20-43cf-8d66-22f6d287bd7a service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Refreshing network info cache for port 5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Start _get_guest_xml network_info=[{"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:54:00 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:00 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-152438196',display_name='tempest-AttachVolumeTestJSON-server-152438196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-152438196',id=30,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLhJthOKkxQ1l2Gdxd/tdSKDRWGyAdK/WlC+g2YG2yH9DtYs5Gktedfpo/aJUDa9TPYYM95TJdn4avr/G+bQ/KR9fhuNEONI7NUwXSzMKHp5Ezq0yXzw30CXNpWN1XxQg==',key_name='tempest-keypair-996746942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-g9y5g2hc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=7b4c0965-3b9f-4be1-b46a-b6b136307536,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:95:1f,bridge_name='br-int',has_traffic_filtering=True,id=5540b31a-0158-4d93-a580-8b7c579e1d73,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5540b31a-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.287s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:54:00 user nova-compute[73007]:   <uuid>7b4c0965-3b9f-4be1-b46a-b6b136307536</uuid>
Aug 15 17:54:00 user nova-compute[73007]:   <name>instance-0000001e</name>
Aug 15 17:54:00 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:54:00 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:54:00 user nova-compute[73007]:   <metadata>
Aug 15 17:54:00 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:54:00 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:54:00 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeTestJSON-server-152438196</nova:name>
Aug 15 17:54:00 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:54:00</nova:creationTime>
Aug 15 17:54:00 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:54:00 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:54:00 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:54:00 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:54:00 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:54:00 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:54:00 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:54:00 user nova-compute[73007]:       <nova:owner>
Aug 15 17:54:00 user nova-compute[73007]:         <nova:user uuid="1395246c93fc4c0dac8d95fffefd9711">tempest-AttachVolumeTestJSON-1742996205-project-member</nova:user>
Aug 15 17:54:00 user nova-compute[73007]:         <nova:project uuid="e1deb9da1fb54f8b8968f01265347c48">tempest-AttachVolumeTestJSON-1742996205</nova:project>
Aug 15 17:54:00 user nova-compute[73007]:       </nova:owner>
Aug 15 17:54:00 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:54:00 user nova-compute[73007]:       <nova:ports>
Aug 15 17:54:00 user nova-compute[73007]:         <nova:port uuid="5540b31a-0158-4d93-a580-8b7c579e1d73">
Aug 15 17:54:00 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 17:54:00 user nova-compute[73007]:         </nova:port>
Aug 15 17:54:00 user nova-compute[73007]:       </nova:ports>
Aug 15 17:54:00 user nova-compute[73007]:     </nova:instance>
Aug 15 17:54:00 user nova-compute[73007]:   </metadata>
Aug 15 17:54:00 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:54:00 user nova-compute[73007]:     <system>
Aug 15 17:54:00 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:54:00 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:54:00 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:54:00 user nova-compute[73007]:       <entry name="serial">7b4c0965-3b9f-4be1-b46a-b6b136307536</entry>
Aug 15 17:54:00 user nova-compute[73007]:       <entry name="uuid">7b4c0965-3b9f-4be1-b46a-b6b136307536</entry>
Aug 15 17:54:00 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:54:00 user nova-compute[73007]:     </system>
Aug 15 17:54:00 user nova-compute[73007]:   </sysinfo>
Aug 15 17:54:00 user nova-compute[73007]:   <os>
Aug 15 17:54:00 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:54:00 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:54:00 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:54:00 user nova-compute[73007]:   </os>
Aug 15 17:54:00 user nova-compute[73007]:   <features>
Aug 15 17:54:00 user nova-compute[73007]:     <acpi/>
Aug 15 17:54:00 user nova-compute[73007]:     <apic/>
Aug 15 17:54:00 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:54:00 user nova-compute[73007]:   </features>
Aug 15 17:54:00 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:54:00 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:54:00 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:54:00 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:54:00 user nova-compute[73007]:   </clock>
Aug 15 17:54:00 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:54:00 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:54:00 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:54:00 user nova-compute[73007]:   </cpu>
Aug 15 17:54:00 user nova-compute[73007]:   <devices>
Aug 15 17:54:00 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:54:00 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:54:00 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk"/>
Aug 15 17:54:00 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:54:00 user nova-compute[73007]:     </disk>
Aug 15 17:54:00 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:54:00 user nova-compute[73007]:       <mac address="fa:16:3e:d8:95:1f"/>
Aug 15 17:54:00 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:00 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:54:00 user nova-compute[73007]:       <target dev="tap5540b31a-01"/>
Aug 15 17:54:00 user nova-compute[73007]:     </interface>
Aug 15 17:54:00 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:54:00 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/console.log" append="off"/>
Aug 15 17:54:00 user nova-compute[73007]:     </serial>
Aug 15 17:54:00 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:54:00 user nova-compute[73007]:     <video>
Aug 15 17:54:00 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:00 user nova-compute[73007]:     </video>
Aug 15 17:54:00 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:54:00 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:54:00 user nova-compute[73007]:     </rng>
Aug 15 17:54:00 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:54:00 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:54:00 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:54:00 user nova-compute[73007]:     </memballoon>
Aug 15 17:54:00 user nova-compute[73007]:   </devices>
Aug 15 17:54:00 user nova-compute[73007]: </domain>
Aug 15 17:54:00 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-152438196',display_name='tempest-AttachVolumeTestJSON-server-152438196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-152438196',id=30,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLhJthOKkxQ1l2Gdxd/tdSKDRWGyAdK/WlC+g2YG2yH9DtYs5Gktedfpo/aJUDa9TPYYM95TJdn4avr/G+bQ/KR9fhuNEONI7NUwXSzMKHp5Ezq0yXzw30CXNpWN1XxQg==',key_name='tempest-keypair-996746942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-g9y5g2hc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=7b4c0965-3b9f-4be1-b46a-b6b136307536,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:95:1f,bridge_name='br-int',has_traffic_filtering=True,id=5540b31a-0158-4d93-a580-8b7c579e1d73,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5540b31a-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG os_vif [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:95:1f,bridge_name='br-int',has_traffic_filtering=True,id=5540b31a-0158-4d93-a580-8b7c579e1d73,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5540b31a-01') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5540b31a-01, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5540b31a-01, col_values=(('external_ids', {'iface-id': '5540b31a-0158-4d93-a580-8b7c579e1d73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:95:1f', 'vm-uuid': '7b4c0965-3b9f-4be1-b46a-b6b136307536'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:54:00 user nova-compute[73007]: INFO os_vif [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:95:1f,bridge_name='br-int',has_traffic_filtering=True,id=5540b31a-0158-4d93-a580-8b7c579e1d73,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5540b31a-01')
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.215s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No VIF found with MAC fa:16:3e:d8:95:1f, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk 1073741824" returned: 0 in 0.071s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Successfully created port: 6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-16d18aa7-29f3-4f6f-88da-067a485c6b51 req-15ab47c6-0c20-43cf-8d66-22f6d287bd7a service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updated VIF entry in instance network info cache for port 5540b31a-0158-4d93-a580-8b7c579e1d73. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-16d18aa7-29f3-4f6f-88da-067a485c6b51 req-15ab47c6-0c20-43cf-8d66-22f6d287bd7a service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updating instance_info_cache with network_info: [{"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.217s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-16d18aa7-29f3-4f6f-88da-067a485c6b51 req-15ab47c6-0c20-43cf-8d66-22f6d287bd7a service nova] Releasing lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Cannot resize image /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.objects.instance [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'migration_context' on Instance uuid 590854c4-c322-4f59-8026-6f1ad3c868f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Ensure instance console log exists: /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-4ca2d12d-58f7-4884-b3b9-985b51aaadc5 req-598ee53d-f949-4beb-9bd7-b3e5d8b3925a service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received event network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4ca2d12d-58f7-4884-b3b9-985b51aaadc5 req-598ee53d-f949-4beb-9bd7-b3e5d8b3925a service nova] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4ca2d12d-58f7-4884-b3b9-985b51aaadc5 req-598ee53d-f949-4beb-9bd7-b3e5d8b3925a service nova] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4ca2d12d-58f7-4884-b3b9-985b51aaadc5 req-598ee53d-f949-4beb-9bd7-b3e5d8b3925a service nova] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-4ca2d12d-58f7-4884-b3b9-985b51aaadc5 req-598ee53d-f949-4beb-9bd7-b3e5d8b3925a service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] No waiting events found dispatching network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:02 user nova-compute[73007]: WARNING nova.compute.manager [req-4ca2d12d-58f7-4884-b3b9-985b51aaadc5 req-598ee53d-f949-4beb-9bd7-b3e5d8b3925a service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received unexpected event network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 for instance with vm_state building and task_state spawning.
Aug 15 17:54:02 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Successfully updated port: 6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquired lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-7eb168e7-c5e3-4c08-bab7-076668007b57 req-d31b3be1-c07a-40b3-9e6c-bc52573dbaae service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received event network-changed-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-7eb168e7-c5e3-4c08-bab7-076668007b57 req-d31b3be1-c07a-40b3-9e6c-bc52573dbaae service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Refreshing instance network info cache due to event network-changed-6eb1c835-6362-4877-b988-855367fe8ef4. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7eb168e7-c5e3-4c08-bab7-076668007b57 req-d31b3be1-c07a-40b3-9e6c-bc52573dbaae service nova] Acquiring lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-6accc42d-2596-480d-89fa-4ff1e09441e3 req-824d0515-a302-466b-8772-62be9dc52bfd service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event volume-reimaged-8e090ef5-d29e-43bf-8295-960b3b25b00b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6accc42d-2596-480d-89fa-4ff1e09441e3 req-824d0515-a302-466b-8772-62be9dc52bfd service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6accc42d-2596-480d-89fa-4ff1e09441e3 req-824d0515-a302-466b-8772-62be9dc52bfd service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6accc42d-2596-480d-89fa-4ff1e09441e3 req-824d0515-a302-466b-8772-62be9dc52bfd service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-6accc42d-2596-480d-89fa-4ff1e09441e3 req-824d0515-a302-466b-8772-62be9dc52bfd service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Processing event volume-reimaged-8e090ef5-d29e-43bf-8295-960b3b25b00b {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance event wait completed in 19 seconds for volume-reimaged {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:03 user nova-compute[73007]: INFO nova.virt.block_device [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Booting with volume 8e090ef5-d29e-43bf-8295-960b3b25b00b at /dev/vda
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG os_brick.utils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48c246c-4d7d-4290-b24e-8a988f7b5c64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d8bcdd-b10c-4ec0-8ce1-98930cd51cb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c0ff54-a9db-4961-8615-8ca1107f5730]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[007171b6-2f21-489a-a0d2-d098c4b0456d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:54:03 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71848a5-1b77-44a2-8bfc-e3179be68906]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG os_brick.utils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updating existing volume attachment record: d3c45699-9fa1-4b63-9457-032fd9ed2681 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Updating instance_info_cache with network_info: [{"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Releasing lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Instance network_info: |[{"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7eb168e7-c5e3-4c08-bab7-076668007b57 req-d31b3be1-c07a-40b3-9e6c-bc52573dbaae service nova] Acquired lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-7eb168e7-c5e3-4c08-bab7-076668007b57 req-d31b3be1-c07a-40b3-9e6c-bc52573dbaae service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Refreshing network info cache for port 6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Start _get_guest_xml network_info=[{"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:54:03 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:03 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1676257365',display_name='tempest-AttachVolumeNegativeTest-server-1676257365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1676257365',id=31,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS6OD1HGEIYe1ounZO5mgIfzoh2y0RWhnYDW8phQY9teDOh+YhfIVsjqxTKAzG99p17xH/ng+MX8RN+ya/55jDQ+QisOIiMIemwH3H+HZm8zZxmXMDQ54nMJDgmNzeozw==',key_name='tempest-keypair-211117878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-0c42mzmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=590854c4-c322-4f59-8026-6f1ad3c868f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:6d:ca,bridge_name='br-int',has_traffic_filtering=True,id=6eb1c835-6362-4877-b988-855367fe8ef4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb1c835-63') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.objects.instance [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'pci_devices' on Instance uuid 590854c4-c322-4f59-8026-6f1ad3c868f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:54:03 user nova-compute[73007]:   <uuid>590854c4-c322-4f59-8026-6f1ad3c868f7</uuid>
Aug 15 17:54:03 user nova-compute[73007]:   <name>instance-0000001f</name>
Aug 15 17:54:03 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:54:03 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:54:03 user nova-compute[73007]:   <metadata>
Aug 15 17:54:03 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:54:03 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:54:03 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1676257365</nova:name>
Aug 15 17:54:03 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:54:03</nova:creationTime>
Aug 15 17:54:03 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:54:03 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:54:03 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:54:03 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:54:03 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:54:03 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:54:03 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:54:03 user nova-compute[73007]:       <nova:owner>
Aug 15 17:54:03 user nova-compute[73007]:         <nova:user uuid="82906484a46f4ad0be9a602aec2affb6">tempest-AttachVolumeNegativeTest-1698859108-project-member</nova:user>
Aug 15 17:54:03 user nova-compute[73007]:         <nova:project uuid="1bfa702dd2884da4b28a84db913819b6">tempest-AttachVolumeNegativeTest-1698859108</nova:project>
Aug 15 17:54:03 user nova-compute[73007]:       </nova:owner>
Aug 15 17:54:03 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:54:03 user nova-compute[73007]:       <nova:ports>
Aug 15 17:54:03 user nova-compute[73007]:         <nova:port uuid="6eb1c835-6362-4877-b988-855367fe8ef4">
Aug 15 17:54:03 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 17:54:03 user nova-compute[73007]:         </nova:port>
Aug 15 17:54:03 user nova-compute[73007]:       </nova:ports>
Aug 15 17:54:03 user nova-compute[73007]:     </nova:instance>
Aug 15 17:54:03 user nova-compute[73007]:   </metadata>
Aug 15 17:54:03 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:54:03 user nova-compute[73007]:     <system>
Aug 15 17:54:03 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:54:03 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:54:03 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:54:03 user nova-compute[73007]:       <entry name="serial">590854c4-c322-4f59-8026-6f1ad3c868f7</entry>
Aug 15 17:54:03 user nova-compute[73007]:       <entry name="uuid">590854c4-c322-4f59-8026-6f1ad3c868f7</entry>
Aug 15 17:54:03 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:54:03 user nova-compute[73007]:     </system>
Aug 15 17:54:03 user nova-compute[73007]:   </sysinfo>
Aug 15 17:54:03 user nova-compute[73007]:   <os>
Aug 15 17:54:03 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:54:03 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:54:03 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:54:03 user nova-compute[73007]:   </os>
Aug 15 17:54:03 user nova-compute[73007]:   <features>
Aug 15 17:54:03 user nova-compute[73007]:     <acpi/>
Aug 15 17:54:03 user nova-compute[73007]:     <apic/>
Aug 15 17:54:03 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:54:03 user nova-compute[73007]:   </features>
Aug 15 17:54:03 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:54:03 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:54:03 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:54:03 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:54:03 user nova-compute[73007]:   </clock>
Aug 15 17:54:03 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:54:03 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:54:03 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:54:03 user nova-compute[73007]:   </cpu>
Aug 15 17:54:03 user nova-compute[73007]:   <devices>
Aug 15 17:54:03 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:54:03 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:54:03 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk"/>
Aug 15 17:54:03 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:54:03 user nova-compute[73007]:     </disk>
Aug 15 17:54:03 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:54:03 user nova-compute[73007]:       <mac address="fa:16:3e:79:6d:ca"/>
Aug 15 17:54:03 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:03 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:54:03 user nova-compute[73007]:       <target dev="tap6eb1c835-63"/>
Aug 15 17:54:03 user nova-compute[73007]:     </interface>
Aug 15 17:54:03 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:54:03 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/console.log" append="off"/>
Aug 15 17:54:03 user nova-compute[73007]:     </serial>
Aug 15 17:54:03 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:54:03 user nova-compute[73007]:     <video>
Aug 15 17:54:03 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:03 user nova-compute[73007]:     </video>
Aug 15 17:54:03 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:54:03 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:54:03 user nova-compute[73007]:     </rng>
Aug 15 17:54:03 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:54:03 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:54:03 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:54:03 user nova-compute[73007]:     </memballoon>
Aug 15 17:54:03 user nova-compute[73007]:   </devices>
Aug 15 17:54:03 user nova-compute[73007]: </domain>
Aug 15 17:54:03 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1676257365',display_name='tempest-AttachVolumeNegativeTest-server-1676257365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1676257365',id=31,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS6OD1HGEIYe1ounZO5mgIfzoh2y0RWhnYDW8phQY9teDOh+YhfIVsjqxTKAzG99p17xH/ng+MX8RN+ya/55jDQ+QisOIiMIemwH3H+HZm8zZxmXMDQ54nMJDgmNzeozw==',key_name='tempest-keypair-211117878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-0c42mzmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=590854c4-c322-4f59-8026-6f1ad3c868f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:6d:ca,bridge_name='br-int',has_traffic_filtering=True,id=6eb1c835-6362-4877-b988-855367fe8ef4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb1c835-63') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG os_vif [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:6d:ca,bridge_name='br-int',has_traffic_filtering=True,id=6eb1c835-6362-4877-b988-855367fe8ef4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb1c835-63') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eb1c835-63, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6eb1c835-63, col_values=(('external_ids', {'iface-id': '6eb1c835-6362-4877-b988-855367fe8ef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:6d:ca', 'vm-uuid': '590854c4-c322-4f59-8026-6f1ad3c868f7'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:54:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:03 user nova-compute[73007]: INFO os_vif [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:6d:ca,bridge_name='br-int',has_traffic_filtering=True,id=6eb1c835-6362-4877-b988-855367fe8ef4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb1c835-63')
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No VIF found with MAC fa:16:3e:79:6d:ca, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.network.neutron [req-7eb168e7-c5e3-4c08-bab7-076668007b57 req-d31b3be1-c07a-40b3-9e6c-bc52573dbaae service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Updated VIF entry in instance network info cache for port 6eb1c835-6362-4877-b988-855367fe8ef4. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.network.neutron [req-7eb168e7-c5e3-4c08-bab7-076668007b57 req-d31b3be1-c07a-40b3-9e6c-bc52573dbaae service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Updating instance_info_cache with network_info: [{"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7eb168e7-c5e3-4c08-bab7-076668007b57 req-d31b3be1-c07a-40b3-9e6c-bc52573dbaae service nova] Releasing lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-1e19bbdc-0f7b-400d-8c99-873b3e39a424 req-a214c0e4-cf08-4035-8926-95d6874694e7 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received event network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1e19bbdc-0f7b-400d-8c99-873b3e39a424 req-a214c0e4-cf08-4035-8926-95d6874694e7 service nova] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1e19bbdc-0f7b-400d-8c99-873b3e39a424 req-a214c0e4-cf08-4035-8926-95d6874694e7 service nova] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1e19bbdc-0f7b-400d-8c99-873b3e39a424 req-a214c0e4-cf08-4035-8926-95d6874694e7 service nova] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-1e19bbdc-0f7b-400d-8c99-873b3e39a424 req-a214c0e4-cf08-4035-8926-95d6874694e7 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] No waiting events found dispatching network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:04 user nova-compute[73007]: WARNING nova.compute.manager [req-1e19bbdc-0f7b-400d-8c99-873b3e39a424 req-a214c0e4-cf08-4035-8926-95d6874694e7 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received unexpected event network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 for instance with vm_state building and task_state spawning.
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122044.9248097, 7b4c0965-3b9f-4be1-b46a-b6b136307536 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:04 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] VM Resumed (Lifecycle Event)
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:04 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Instance spawned successfully.
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:54:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:05 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122044.9294589, 7b4c0965-3b9f-4be1-b46a-b6b136307536 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:05 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] VM Started (Lifecycle Event)
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updating instance_info_cache with network_info: [{"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:05 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:05 user nova-compute[73007]: INFO nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Took 6.89 seconds to spawn the instance on the hypervisor.
Aug 15 17:54:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:05 user nova-compute[73007]: INFO nova.compute.manager [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Took 7.87 seconds to build instance.
Aug 15 17:54:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b977a8b5-2a43-4028-ba3b-9dcb100efb5f tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.998s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-3d2677ec-1aeb-4a63-9b84-37286fe9afed req-bfb456d4-de29-47b4-91b7-be2a9df7954e service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received event network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d2677ec-1aeb-4a63-9b84-37286fe9afed req-bfb456d4-de29-47b4-91b7-be2a9df7954e service nova] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d2677ec-1aeb-4a63-9b84-37286fe9afed req-bfb456d4-de29-47b4-91b7-be2a9df7954e service nova] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d2677ec-1aeb-4a63-9b84-37286fe9afed req-bfb456d4-de29-47b4-91b7-be2a9df7954e service nova] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-3d2677ec-1aeb-4a63-9b84-37286fe9afed req-bfb456d4-de29-47b4-91b7-be2a9df7954e service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] No waiting events found dispatching network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:06 user nova-compute[73007]: WARNING nova.compute.manager [req-3d2677ec-1aeb-4a63-9b84-37286fe9afed req-bfb456d4-de29-47b4-91b7-be2a9df7954e service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received unexpected event network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 for instance with vm_state building and task_state spawning.
Aug 15 17:54:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122047.9420283, 590854c4-c322-4f59-8026-6f1ad3c868f7 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:07 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] VM Resumed (Lifecycle Event)
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:54:07 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Instance spawned successfully.
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:07 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:07 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122047.9464393, 590854c4-c322-4f59-8026-6f1ad3c868f7 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:07 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] VM Started (Lifecycle Event)
Aug 15 17:54:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:08 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf7742e-b047-480c-b48e-9e809d3503de req-ab836e4f-5e5e-4143-b291-d622b212d749 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received event network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf7742e-b047-480c-b48e-9e809d3503de req-ab836e4f-5e5e-4143-b291-d622b212d749 service nova] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf7742e-b047-480c-b48e-9e809d3503de req-ab836e4f-5e5e-4143-b291-d622b212d749 service nova] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4cf7742e-b047-480c-b48e-9e809d3503de req-ab836e4f-5e5e-4143-b291-d622b212d749 service nova] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-4cf7742e-b047-480c-b48e-9e809d3503de req-ab836e4f-5e5e-4143-b291-d622b212d749 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] No waiting events found dispatching network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:08 user nova-compute[73007]: WARNING nova.compute.manager [req-4cf7742e-b047-480c-b48e-9e809d3503de req-ab836e4f-5e5e-4143-b291-d622b212d749 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received unexpected event network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 for instance with vm_state building and task_state spawning.
Aug 15 17:54:08 user nova-compute[73007]: INFO nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Took 7.64 seconds to spawn the instance on the hypervisor.
Aug 15 17:54:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:08 user nova-compute[73007]: INFO nova.compute.manager [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Took 8.60 seconds to build instance.
Aug 15 17:54:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0b125039-7d45-49f9-a425-46a3ea0c2dc6 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.745s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:09 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:15 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=25.386085510253906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Applying migration context for instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 as it has an incoming, in-progress migration 92c9d9f0-f763-4c05-a6bb-bd2a6dcf26e5. Migration status is finished {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 17:54:15 user nova-compute[73007]: INFO nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating resource usage from migration 92c9d9f0-f763-4c05-a6bb-bd2a6dcf26e5
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:54:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Creating image(s)
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Ensure instance console log exists: /opt/stack/data/nova/instances/e6bc8143-ca4e-40cb-a38d-0a1caec7eb61/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Start _get_guest_xml network_info=[{"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6bc8143-ca4e-40cb-a38d-0a1caec7eb61', 'attached_at': '', 'detached_at': '', 'volume_id': '8e090ef5-d29e-43bf-8295-960b3b25b00b', 'serial': '8e090ef5-d29e-43bf-8295-960b3b25b00b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'd3c45699-9fa1-4b63-9457-032fd9ed2681', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:54:15 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 17:54:15 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:54:15 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:54:15 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:54:15 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2850597b-e2fd-487a-8ec4-3fc7a041ae3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:54:15 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b2554a-1667-43b8-8875-eea6bef58d6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b] added
Aug 15 17:54:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e535c59-387d-41e0-a919-63bba8d0c666]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Migration 92c9d9f0-f763-4c05-a6bb-bd2a6dcf26e5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 590854c4-c322-4f59-8026-6f1ad3c868f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a022cef2-5cd8-4be9-98be-27cfffb4a5ba]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMeNEvxZ {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMeNEvxZ" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba5dba-b3a9-4704-b829-eb53af84c3ab]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMeNEvxZ'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ab810b-d26a-4215-a803-7a1b7e1b2e9e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf58c85e-c8dd-4d9b-a124-6be328c94b2d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:15 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:15 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f65336-d1c7-48bc-a51f-b03a76640c8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260]
Aug 15 17:54:15 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260] successful.
Aug 15 17:54:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d140c4-09f5-4687-aabd-1db35cad0305]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3654b212-42c8-494a-9e20-0ecb78931259]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:15 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:15 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:15 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:15 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[88288a21-a9f2-443b-a075-ba11c1b86b8f]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:54:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.972s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26236376530366436', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236376530366436', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1318095534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1935026486',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIvgMz7mYpX7D05Wb4MZinjT0gPxrata4a0MrGnRjy415APQIOBp9A9kgHgddReowFznukjRHIxc2JaK1t+GuWtb14Fs3FEJXbWoBXhofsNDiEYHbnLbLukZFbdXs0nXg==',key_name='tempest-keypair-1261262527',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ee8ba5df700457f9f97355fd864bece',ramdisk_id='',reservation_id='r-qcdh0wm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1292950819',owner_user_name='tempest-ServerActionsV293TestJSON-1292950819-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de582a0433c424c8f7f76d74b9abe09',uuid=e6bc8143-ca4e-40cb-a38d-0a1caec7eb61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converting VIF {"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:54:16 user nova-compute[73007]:   <uuid>e6bc8143-ca4e-40cb-a38d-0a1caec7eb61</uuid>
Aug 15 17:54:16 user nova-compute[73007]:   <name>instance-0000001a</name>
Aug 15 17:54:16 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:54:16 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:54:16 user nova-compute[73007]:   <metadata>
Aug 15 17:54:16 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:54:16 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:54:16 user nova-compute[73007]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1318095534</nova:name>
Aug 15 17:54:16 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:54:15</nova:creationTime>
Aug 15 17:54:16 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:54:16 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:54:16 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:54:16 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:54:16 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:54:16 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:54:16 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:54:16 user nova-compute[73007]:       <nova:owner>
Aug 15 17:54:16 user nova-compute[73007]:         <nova:user uuid="8de582a0433c424c8f7f76d74b9abe09">tempest-ServerActionsV293TestJSON-1292950819-project-member</nova:user>
Aug 15 17:54:16 user nova-compute[73007]:         <nova:project uuid="1ee8ba5df700457f9f97355fd864bece">tempest-ServerActionsV293TestJSON-1292950819</nova:project>
Aug 15 17:54:16 user nova-compute[73007]:       </nova:owner>
Aug 15 17:54:16 user nova-compute[73007]:       <nova:ports>
Aug 15 17:54:16 user nova-compute[73007]:         <nova:port uuid="e8a4549a-52c9-4091-a515-2515a704233a">
Aug 15 17:54:16 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 17:54:16 user nova-compute[73007]:         </nova:port>
Aug 15 17:54:16 user nova-compute[73007]:       </nova:ports>
Aug 15 17:54:16 user nova-compute[73007]:     </nova:instance>
Aug 15 17:54:16 user nova-compute[73007]:   </metadata>
Aug 15 17:54:16 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:54:16 user nova-compute[73007]:     <system>
Aug 15 17:54:16 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:54:16 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:54:16 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:54:16 user nova-compute[73007]:       <entry name="serial">e6bc8143-ca4e-40cb-a38d-0a1caec7eb61</entry>
Aug 15 17:54:16 user nova-compute[73007]:       <entry name="uuid">e6bc8143-ca4e-40cb-a38d-0a1caec7eb61</entry>
Aug 15 17:54:16 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:54:16 user nova-compute[73007]:     </system>
Aug 15 17:54:16 user nova-compute[73007]:   </sysinfo>
Aug 15 17:54:16 user nova-compute[73007]:   <os>
Aug 15 17:54:16 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:54:16 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:54:16 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:54:16 user nova-compute[73007]:   </os>
Aug 15 17:54:16 user nova-compute[73007]:   <features>
Aug 15 17:54:16 user nova-compute[73007]:     <acpi/>
Aug 15 17:54:16 user nova-compute[73007]:     <apic/>
Aug 15 17:54:16 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:54:16 user nova-compute[73007]:   </features>
Aug 15 17:54:16 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:54:16 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:54:16 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:54:16 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:54:16 user nova-compute[73007]:   </clock>
Aug 15 17:54:16 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:54:16 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:54:16 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:54:16 user nova-compute[73007]:   </cpu>
Aug 15 17:54:16 user nova-compute[73007]:   <devices>
Aug 15 17:54:16 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:54:16 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:54:16 user nova-compute[73007]:       <source dev="/dev/sdb"/>
Aug 15 17:54:16 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:54:16 user nova-compute[73007]:       <serial>8e090ef5-d29e-43bf-8295-960b3b25b00b</serial>
Aug 15 17:54:16 user nova-compute[73007]:     </disk>
Aug 15 17:54:16 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:54:16 user nova-compute[73007]:       <mac address="fa:16:3e:d1:2d:07"/>
Aug 15 17:54:16 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:16 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:54:16 user nova-compute[73007]:       <target dev="tape8a4549a-52"/>
Aug 15 17:54:16 user nova-compute[73007]:     </interface>
Aug 15 17:54:16 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:54:16 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/e6bc8143-ca4e-40cb-a38d-0a1caec7eb61/console.log" append="off"/>
Aug 15 17:54:16 user nova-compute[73007]:     </serial>
Aug 15 17:54:16 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:54:16 user nova-compute[73007]:     <video>
Aug 15 17:54:16 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:16 user nova-compute[73007]:     </video>
Aug 15 17:54:16 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:54:16 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:54:16 user nova-compute[73007]:     </rng>
Aug 15 17:54:16 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:54:16 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:54:16 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:54:16 user nova-compute[73007]:     </memballoon>
Aug 15 17:54:16 user nova-compute[73007]:   </devices>
Aug 15 17:54:16 user nova-compute[73007]: </domain>
Aug 15 17:54:16 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1318095534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1935026486',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIvgMz7mYpX7D05Wb4MZinjT0gPxrata4a0MrGnRjy415APQIOBp9A9kgHgddReowFznukjRHIxc2JaK1t+GuWtb14Fs3FEJXbWoBXhofsNDiEYHbnLbLukZFbdXs0nXg==',key_name='tempest-keypair-1261262527',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ee8ba5df700457f9f97355fd864bece',ramdisk_id='',reservation_id='r-qcdh0wm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1292950819',owner_user_name='tempest-ServerActionsV293TestJSON-1292950819-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de582a0433c424c8f7f76d74b9abe09',uuid=e6bc8143-ca4e-40cb-a38d-0a1caec7eb61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converting VIF {"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG os_vif [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8a4549a-52, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8a4549a-52, col_values=(('external_ids', {'iface-id': 'e8a4549a-52c9-4091-a515-2515a704233a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:2d:07', 'vm-uuid': 'e6bc8143-ca4e-40cb-a38d-0a1caec7eb61'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:54:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:16 user nova-compute[73007]: INFO os_vif [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52')
Aug 15 17:54:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:54:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] No VIF found with MAC fa:16:3e:d1:2d:07, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:54:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-c6900263-9f22-40ff-815f-ff61cf15e958 req-3fc978af-dd5a-481d-b3ab-b3b57ac89936 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c6900263-9f22-40ff-815f-ff61cf15e958 req-3fc978af-dd5a-481d-b3ab-b3b57ac89936 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c6900263-9f22-40ff-815f-ff61cf15e958 req-3fc978af-dd5a-481d-b3ab-b3b57ac89936 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c6900263-9f22-40ff-815f-ff61cf15e958 req-3fc978af-dd5a-481d-b3ab-b3b57ac89936 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-c6900263-9f22-40ff-815f-ff61cf15e958 req-3fc978af-dd5a-481d-b3ab-b3b57ac89936 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:18 user nova-compute[73007]: WARNING nova.compute.manager [req-c6900263-9f22-40ff-815f-ff61cf15e958 req-3fc978af-dd5a-481d-b3ab-b3b57ac89936 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state rebuild_spawning.
Aug 15 17:54:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-9b8cf779-ca74-442b-8a39-96b718208e6f req-159f7ae9-3fa8-4a6f-ac7c-75c7526ea94e service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9b8cf779-ca74-442b-8a39-96b718208e6f req-159f7ae9-3fa8-4a6f-ac7c-75c7526ea94e service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9b8cf779-ca74-442b-8a39-96b718208e6f req-159f7ae9-3fa8-4a6f-ac7c-75c7526ea94e service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9b8cf779-ca74-442b-8a39-96b718208e6f req-159f7ae9-3fa8-4a6f-ac7c-75c7526ea94e service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-9b8cf779-ca74-442b-8a39-96b718208e6f req-159f7ae9-3fa8-4a6f-ac7c-75c7526ea94e service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:20 user nova-compute[73007]: WARNING nova.compute.manager [req-9b8cf779-ca74-442b-8a39-96b718208e6f req-159f7ae9-3fa8-4a6f-ac7c-75c7526ea94e service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state rebuild_spawning.
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122060.8152986, e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:20 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] VM Resumed (Lifecycle Event)
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:54:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance spawned successfully.
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:20 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122060.8192713, e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:20 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] VM Started (Lifecycle Event)
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:20 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 17:54:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73007) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 17:54:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6accc42d-2596-480d-89fa-4ff1e09441e3 tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "28635f62-bb70-454f-ab7a-c40e48ba2950" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:54:22 user nova-compute[73007]: INFO nova.compute.claims [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Claim successful on node user
Aug 15 17:54:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:54:23 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:54:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG nova.policy [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cd910b3e8bf406f8512b3470f6eaca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eebca3ef0a45788b0dfbc03b01fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:54:23 user nova-compute[73007]: INFO nova.virt.block_device [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Booting with volume 2edbf841-b58b-42cf-875b-c211698d6208 at /dev/vda
Aug 15 17:54:23 user nova-compute[73007]: DEBUG os_brick.utils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7772d93-99a2-4109-9ca5-db73f8f2f3ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da0411f-2d38-41fe-bc79-90025849a9f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba14103-fd81-4559-a1c1-e24f4da78de6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307f362-0fba-40e2-b27f-5c8b3a204f2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:54:23 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:54:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c37f6d-a1af-41f8-8c7b-d07063488c55]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG os_brick.utils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:54:23 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Updating existing volume attachment record: 523a7e29-fe07-4e91-bac2-70d211176861 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:54:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Successfully created port: 45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:54:24 user nova-compute[73007]: INFO nova.compute.manager [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Rescuing
Aug 15 17:54:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquired lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updating instance_info_cache with network_info: [{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Releasing lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Successfully updated port: 45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-1068058d-6904-45d9-a427-85e912eaa00c req-6e9de5a0-044a-4a8a-b76a-b2d2ba95e3bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received event network-changed-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-1068058d-6904-45d9-a427-85e912eaa00c req-6e9de5a0-044a-4a8a-b76a-b2d2ba95e3bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Refreshing instance network info cache due to event network-changed-45a77f07-1a76-4b20-ad45-4e2f30e44f81. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1068058d-6904-45d9-a427-85e912eaa00c req-6e9de5a0-044a-4a8a-b76a-b2d2ba95e3bc service nova] Acquiring lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1068058d-6904-45d9-a427-85e912eaa00c req-6e9de5a0-044a-4a8a-b76a-b2d2ba95e3bc service nova] Acquired lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-1068058d-6904-45d9-a427-85e912eaa00c req-6e9de5a0-044a-4a8a-b76a-b2d2ba95e3bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Refreshing network info cache for port 45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-1068058d-6904-45d9-a427-85e912eaa00c req-6e9de5a0-044a-4a8a-b76a-b2d2ba95e3bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-1068058d-6904-45d9-a427-85e912eaa00c req-6e9de5a0-044a-4a8a-b76a-b2d2ba95e3bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-a1d0752a-667d-43c5-85ee-54149c73106e req-8f57a219-3f45-4f32-a7fb-9c33a3193855 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a1d0752a-667d-43c5-85ee-54149c73106e req-8f57a219-3f45-4f32-a7fb-9c33a3193855 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a1d0752a-667d-43c5-85ee-54149c73106e req-8f57a219-3f45-4f32-a7fb-9c33a3193855 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a1d0752a-667d-43c5-85ee-54149c73106e req-8f57a219-3f45-4f32-a7fb-9c33a3193855 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-a1d0752a-667d-43c5-85ee-54149c73106e req-8f57a219-3f45-4f32-a7fb-9c33a3193855 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:25 user nova-compute[73007]: WARNING nova.compute.manager [req-a1d0752a-667d-43c5-85ee-54149c73106e req-8f57a219-3f45-4f32-a7fb-9c33a3193855 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state active and task_state rescuing.
Aug 15 17:54:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1068058d-6904-45d9-a427-85e912eaa00c req-6e9de5a0-044a-4a8a-b76a-b2d2ba95e3bc service nova] Releasing lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquired lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:54:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:54:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance destroyed successfully.
Aug 15 17:54:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Attempting a stable device rescue
Aug 15 17:54:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73007) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 17:54:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance directory exists: not creating {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 17:54:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Creating image(s)
Aug 15 17:54:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "/opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "/opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'trusted_certs' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "9f914e1f9a0edb35035a702439d3166aa7719902" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "9f914e1f9a0edb35035a702439d3166aa7719902" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-efce93b0-6a88-40b7-b735-38d598444794 req-4c1451dc-32b6-4134-a03e-c60f273a1dea service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-efce93b0-6a88-40b7-b735-38d598444794 req-4c1451dc-32b6-4134-a03e-c60f273a1dea service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-efce93b0-6a88-40b7-b735-38d598444794 req-4c1451dc-32b6-4134-a03e-c60f273a1dea service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-efce93b0-6a88-40b7-b735-38d598444794 req-4c1451dc-32b6-4134-a03e-c60f273a1dea service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-efce93b0-6a88-40b7-b735-38d598444794 req-4c1451dc-32b6-4134-a03e-c60f273a1dea service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:27 user nova-compute[73007]: WARNING nova.compute.manager [req-efce93b0-6a88-40b7-b735-38d598444794 req-4c1451dc-32b6-4134-a03e-c60f273a1dea service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state active and task_state rescuing.
Aug 15 17:54:27 user nova-compute[73007]: DEBUG nova.network.neutron [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Updating instance_info_cache with network_info: [{"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902.part --force-share --output=json" returned: 0 in 0.195s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG nova.virt.images [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] 5100cf18-0393-4ff9-9f6a-af2ca3e4b23d was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902.part /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Releasing lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Instance network_info: |[{"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902.part /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902.converted" returned: 0 in 0.356s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "9f914e1f9a0edb35035a702439d3166aa7719902" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.265s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "9f914e1f9a0edb35035a702439d3166aa7719902" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "9f914e1f9a0edb35035a702439d3166aa7719902" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902 --force-share --output=json" returned: 0 in 0.222s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902,backing_fmt=raw /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902,backing_fmt=raw /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue" returned: 0 in 0.057s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "9f914e1f9a0edb35035a702439d3166aa7719902" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'migration_context' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Start _get_guest_xml network_info=[{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "vif_mac": "fa:16:3e:22:7a:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5100cf18-0393-4ff9-9f6a-af2ca3e4b23d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTqhdmxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c8047564-c2ee-43f4-b423-cc9c686eabc1', 'attached_at': '', 'detached_at': '', 'volume_id': 'e90625eb-7440-48c6-8d3e-b9abdd875692', 'serial': 'e90625eb-7440-48c6-8d3e-b9abdd875692'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'be486afb-f9b7-44ee-8aef-aab4df09932e', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'resources' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'numa_topology' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:28 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:28 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'vcpu_model' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTqhdmxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:54:28 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:54:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:54:28 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:54:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:54:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:54:28 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:54:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86e1ff1-8a7e-493d-8ab9-28c722a9778a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UTqhdmxG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 17:54:29 user nova-compute[73007]: node.name = iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692
Aug 15 17:54:29 user nova-compute[73007]: node.tpgt = -1
Aug 15 17:54:29 user nova-compute[73007]: node.startup = automatic
Aug 15 17:54:29 user nova-compute[73007]: node.leading_login = No
Aug 15 17:54:29 user nova-compute[73007]: iface.iscsi_ifacename = default
Aug 15 17:54:29 user nova-compute[73007]: iface.net_ifacename = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.ipaddress = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.prefix_len = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.hwaddress = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.transport_name = tcp
Aug 15 17:54:29 user nova-compute[73007]: iface.initiatorname = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.state = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.vlan_id = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.vlan_priority = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.vlan_state = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.iface_num = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.mtu = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.port = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.bootproto = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.subnet_mask = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.gateway = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.dhcp_alt_client_id = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.dhcp_dns = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.dhcp_learn_iqn = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.dhcp_vendor_id_state = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.dhcp_vendor_id = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.dhcp_slp_da = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.fragmentation = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.gratuitous_arp = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.incoming_forwarding = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.tos_state = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.tos = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.ttl = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.delayed_ack = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.tcp_nagle = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.tcp_wsf_state = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.tcp_wsf = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.tcp_timer_scale = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.tcp_timestamp = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.redirect = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.def_task_mgmt_timeout = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.header_digest = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.data_digest = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.immediate_data = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.initial_r2t = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.data_seq_inorder = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.data_pdu_inorder = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.erl = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.max_receive_data_len = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.first_burst_len = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.max_outstanding_r2t = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.max_burst_len = 0
Aug 15 17:54:29 user nova-compute[73007]: iface.chap_auth = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.bidi_chap = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.strict_login_compliance = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.discovery_auth = <empty>
Aug 15 17:54:29 user nova-compute[73007]: iface.discovery_logout = <empty>
Aug 15 17:54:29 user nova-compute[73007]: node.discovery_address = <empty>
Aug 15 17:54:29 user nova-compute[73007]: node.discovery_port = 0
Aug 15 17:54:29 user nova-compute[73007]: node.discovery_type = static
Aug 15 17:54:29 user nova-compute[73007]: node.session.initial_cmdsn = 0
Aug 15 17:54:29 user nova-compute[73007]: node.session.initial_login_retry_max = 8
Aug 15 17:54:29 user nova-compute[73007]: node.session.xmit_thread_priority = -20
Aug 15 17:54:29 user nova-compute[73007]: node.session.cmds_max = 128
Aug 15 17:54:29 user nova-compute[73007]: node.session.queue_depth = 32
Aug 15 17:54:29 user nova-compute[73007]: node.session.nr_sessions = 1
Aug 15 17:54:29 user nova-compute[73007]: node.session.auth.authmethod = CHAP
Aug 15 17:54:29 user nova-compute[73007]: node.session.auth.username = UTqhdmxG
Aug 15 17:54:29 user nova-compute[73007]: node.session.auth.password = ***
Aug 15 17:54:29 user nova-compute[73007]: node.session.auth.username_in = <empty>
Aug 15 17:54:29 user nova-compute[73007]: node.session.auth.password_in = <empty>
Aug 15 17:54:29 user nova-compute[73007]: node.session.auth.chap_algs = MD5
Aug 15 17:54:29 user nova-compute[73007]: node.session.timeo.replacement_timeout = 120
Aug 15 17:54:29 user nova-compute[73007]: node.session.err_timeo.abort_timeout = 15
Aug 15 17:54:29 user nova-compute[73007]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 17:54:29 user nova-compute[73007]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 17:54:29 user nova-compute[73007]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.FastAbort = Yes
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.InitialR2T = No
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.ImmediateData = Yes
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.MaxConnections = 1
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 17:54:29 user nova-compute[73007]: node.session.iscsi.ERL = 0
Aug 15 17:54:29 user nova-compute[73007]: node.session.scan = manual
Aug 15 17:54:29 user nova-compute[73007]: node.session.reopen_max = 0
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].address = 172.16.0.220
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].port = 3260
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].startup = manual
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].tcp.window_size = 524288
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].tcp.type_of_service = 0
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].timeo.logout_timeout = 15
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].timeo.login_timeout = 15
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].timeo.auth_timeout = 45
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].iscsi.DataDigest = None
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].iscsi.IFMarker = No
Aug 15 17:54:29 user nova-compute[73007]: node.conn[0].iscsi.OFMarker = No
Aug 15 17:54:29 user nova-compute[73007]: # END RECORD
Aug 15 17:54:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[270eeee5-05d0-42f3-bb88-8669865da891]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[526aa7f9-a868-4b8e-af7c-902cd0c9782b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTqhdmxG {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTqhdmxG" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f035fa-e425-4691-9f7b-50e232045a89]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTqhdmxG'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef31a763-4371-4523-9f6f-55e032ecef26]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f489c8-0e81-4b33-ad38-0cad371a68fd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:29 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:29 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:29 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:29 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] HCTL ('34', '0', '0', 0) found on session 28 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[581fb561-53be-43f0-84cc-88040a75305c]: (4, ('0 0 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching for a device in session 28 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTqhdmxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23037343535353861', 'path': '/dev/sdc'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037343535353861', 'path': '/dev/sdc'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-562465900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-562465900',id=29,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-c8534a7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:52:55Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=c8047564-c2ee-43f4-b423-cc9c686eabc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "vif_mac": "fa:16:3e:22:7a:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "vif_mac": "fa:16:3e:22:7a:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:7a:fe,bridge_name='br-int',has_traffic_filtering=True,id=a994297e-f116-4704-93f6-99f23e05ca85,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa994297e-f1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'pci_devices' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:54:29 user nova-compute[73007]:   <uuid>c8047564-c2ee-43f4-b423-cc9c686eabc1</uuid>
Aug 15 17:54:29 user nova-compute[73007]:   <name>instance-0000001d</name>
Aug 15 17:54:29 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:54:29 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:54:29 user nova-compute[73007]:   <metadata>
Aug 15 17:54:29 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:54:29 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:54:29 user nova-compute[73007]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-562465900</nova:name>
Aug 15 17:54:29 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:54:28</nova:creationTime>
Aug 15 17:54:29 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:54:29 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:54:29 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:54:29 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:54:29 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:54:29 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:54:29 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:54:29 user nova-compute[73007]:       <nova:owner>
Aug 15 17:54:29 user nova-compute[73007]:         <nova:user uuid="2b7b5264253d44e9a51d06f66bed1443">tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member</nova:user>
Aug 15 17:54:29 user nova-compute[73007]:         <nova:project uuid="6e88231a35bb4a2e8b5e1e7d5e5f9418">tempest-ServerBootFromVolumeStableRescueTest-452961283</nova:project>
Aug 15 17:54:29 user nova-compute[73007]:       </nova:owner>
Aug 15 17:54:29 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:54:29 user nova-compute[73007]:       <nova:ports>
Aug 15 17:54:29 user nova-compute[73007]:         <nova:port uuid="a994297e-f116-4704-93f6-99f23e05ca85">
Aug 15 17:54:29 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 17:54:29 user nova-compute[73007]:         </nova:port>
Aug 15 17:54:29 user nova-compute[73007]:       </nova:ports>
Aug 15 17:54:29 user nova-compute[73007]:     </nova:instance>
Aug 15 17:54:29 user nova-compute[73007]:   </metadata>
Aug 15 17:54:29 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:54:29 user nova-compute[73007]:     <system>
Aug 15 17:54:29 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:54:29 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:54:29 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:54:29 user nova-compute[73007]:       <entry name="serial">c8047564-c2ee-43f4-b423-cc9c686eabc1</entry>
Aug 15 17:54:29 user nova-compute[73007]:       <entry name="uuid">c8047564-c2ee-43f4-b423-cc9c686eabc1</entry>
Aug 15 17:54:29 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:54:29 user nova-compute[73007]:     </system>
Aug 15 17:54:29 user nova-compute[73007]:   </sysinfo>
Aug 15 17:54:29 user nova-compute[73007]:   <os>
Aug 15 17:54:29 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:54:29 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:54:29 user nova-compute[73007]:   </os>
Aug 15 17:54:29 user nova-compute[73007]:   <features>
Aug 15 17:54:29 user nova-compute[73007]:     <acpi/>
Aug 15 17:54:29 user nova-compute[73007]:     <apic/>
Aug 15 17:54:29 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:54:29 user nova-compute[73007]:   </features>
Aug 15 17:54:29 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:54:29 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:54:29 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:54:29 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:54:29 user nova-compute[73007]:   </clock>
Aug 15 17:54:29 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:54:29 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:54:29 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:54:29 user nova-compute[73007]:   </cpu>
Aug 15 17:54:29 user nova-compute[73007]:   <devices>
Aug 15 17:54:29 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:54:29 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:54:29 user nova-compute[73007]:       <source dev="/dev/sdc"/>
Aug 15 17:54:29 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:54:29 user nova-compute[73007]:       <serial>e90625eb-7440-48c6-8d3e-b9abdd875692</serial>
Aug 15 17:54:29 user nova-compute[73007]:     </disk>
Aug 15 17:54:29 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:54:29 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:54:29 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue"/>
Aug 15 17:54:29 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:54:29 user nova-compute[73007]:       <boot order="1"/>
Aug 15 17:54:29 user nova-compute[73007]:     </disk>
Aug 15 17:54:29 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:54:29 user nova-compute[73007]:       <mac address="fa:16:3e:22:7a:fe"/>
Aug 15 17:54:29 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:29 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:54:29 user nova-compute[73007]:       <target dev="tapa994297e-f1"/>
Aug 15 17:54:29 user nova-compute[73007]:     </interface>
Aug 15 17:54:29 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:54:29 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/console.log" append="off"/>
Aug 15 17:54:29 user nova-compute[73007]:     </serial>
Aug 15 17:54:29 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:54:29 user nova-compute[73007]:     <video>
Aug 15 17:54:29 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:29 user nova-compute[73007]:     </video>
Aug 15 17:54:29 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:54:29 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:54:29 user nova-compute[73007]:     </rng>
Aug 15 17:54:29 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:54:29 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:54:29 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:54:29 user nova-compute[73007]:     </memballoon>
Aug 15 17:54:29 user nova-compute[73007]:   </devices>
Aug 15 17:54:29 user nova-compute[73007]: </domain>
Aug 15 17:54:29 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:54:29 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance destroyed successfully.
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:54:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No VIF found with MAC fa:16:3e:22:7a:fe, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-10300266-85c3-4a05-9889-85fbcb68bd05 req-571836e9-8f49-4d0e-bee2-e5bcf6ca5a74 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-10300266-85c3-4a05-9889-85fbcb68bd05 req-571836e9-8f49-4d0e-bee2-e5bcf6ca5a74 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-10300266-85c3-4a05-9889-85fbcb68bd05 req-571836e9-8f49-4d0e-bee2-e5bcf6ca5a74 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-10300266-85c3-4a05-9889-85fbcb68bd05 req-571836e9-8f49-4d0e-bee2-e5bcf6ca5a74 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-10300266-85c3-4a05-9889-85fbcb68bd05 req-571836e9-8f49-4d0e-bee2-e5bcf6ca5a74 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:30 user nova-compute[73007]: WARNING nova.compute.manager [req-10300266-85c3-4a05-9889-85fbcb68bd05 req-571836e9-8f49-4d0e-bee2-e5bcf6ca5a74 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state active and task_state rescuing.
Aug 15 17:54:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4782d6cf-cc91-4dcf-881c-34d9d87e4897 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for c8047564-c2ee-43f4-b423-cc9c686eabc1 due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 17:54:32 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122072.9527845, c8047564-c2ee-43f4-b423-cc9c686eabc1 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] VM Resumed (Lifecycle Event)
Aug 15 17:54:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122072.9545803, c8047564-c2ee-43f4-b423-cc9c686eabc1 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] VM Started (Lifecycle Event)
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-439d04da-a8c1-4f3b-bb36-b1cc8dfb089c req-54ff26a2-b379-44df-818a-7b7cd232b1b9 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-439d04da-a8c1-4f3b-bb36-b1cc8dfb089c req-54ff26a2-b379-44df-818a-7b7cd232b1b9 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-439d04da-a8c1-4f3b-bb36-b1cc8dfb089c req-54ff26a2-b379-44df-818a-7b7cd232b1b9 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-439d04da-a8c1-4f3b-bb36-b1cc8dfb089c req-54ff26a2-b379-44df-818a-7b7cd232b1b9 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-439d04da-a8c1-4f3b-bb36-b1cc8dfb089c req-54ff26a2-b379-44df-818a-7b7cd232b1b9 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:33 user nova-compute[73007]: WARNING nova.compute.manager [req-439d04da-a8c1-4f3b-bb36-b1cc8dfb089c req-54ff26a2-b379-44df-818a-7b7cd232b1b9 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state rescued and task_state None.
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:54:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Creating image(s)
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Ensure instance console log exists: /opt/stack/data/nova/instances/28635f62-bb70-454f-ab7a-c40e48ba2950/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Start _get_guest_xml network_info=[{"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLMtZAuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28635f62-bb70-454f-ab7a-c40e48ba2950', 'attached_at': '', 'detached_at': '', 'volume_id': '2edbf841-b58b-42cf-875b-c211698d6208', 'serial': '2edbf841-b58b-42cf-875b-c211698d6208'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '523a7e29-fe07-4e91-bac2-70d211176861', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:54:33 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:33 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLMtZAuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:54:33 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:54:33 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:54:33 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1be9e9-fb02-4d99-b6d5-53547f99fcad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:54:33 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b5ba47-5813-4ebe-91ad-da96c46d2bde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208] added
Aug 15 17:54:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb21e9ca-11f5-413e-9dc1-314630d42757]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb149a3-ee48-4fe8-9800-a73287d31039]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLMtZAuV {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yLMtZAuV" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfd2ac3-ac8f-46ca-9a07-d63c424cbaf6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yLMtZAuV'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffe2ec0-fd2e-4f6b-be04-82f37d4a691c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0be33a-1295-4492-b00b-07b02aaf1e91]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:34 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:34 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4407264f-c6c7-4d77-b90f-1b7e5756059c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208, portal: 172.16.0.220,3260]
Aug 15 17:54:34 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208, portal: 172.16.0.220,3260] successful.
Aug 15 17:54:34 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[550840de-eedf-41c2-bc37-972eae6ebc4a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5488971-93da-45a8-a26a-fb62ff83cdf7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:34 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:54:34 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a830962-44a7-46b7-b27d-4ad267bc6ef3]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:54:34 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLMtZAuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23835643539636666', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835643539636666', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-468031183',display_name='tempest-TestVolumeBootPattern-volume-backed-server-468031183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-468031183',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCeLFsG2e8bauw7/mxxyUA+2AowhFfO5TuGjjgxATqYoVhx8pEyfnHSefCAuC+Js0v/IoiaU5y+P5kAWBvbmMNjqb/c0gU3uRFkQ/gheaDk9YScOI/ODxPYZ3b6qIlTxg==',key_name='tempest-keypair-947905252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-bvcz0ig0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=28635f62-bb70-454f-ab7a-c40e48ba2950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=45a77f07-1a76-4b20-ad45-4e2f30e44f81,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a77f07-1a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.objects.instance [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'pci_devices' on Instance uuid 28635f62-bb70-454f-ab7a-c40e48ba2950 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:54:35 user nova-compute[73007]:   <uuid>28635f62-bb70-454f-ab7a-c40e48ba2950</uuid>
Aug 15 17:54:35 user nova-compute[73007]:   <name>instance-00000020</name>
Aug 15 17:54:35 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:54:35 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:54:35 user nova-compute[73007]:   <metadata>
Aug 15 17:54:35 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:54:35 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:54:35 user nova-compute[73007]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-468031183</nova:name>
Aug 15 17:54:35 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:54:33</nova:creationTime>
Aug 15 17:54:35 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:54:35 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:54:35 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:54:35 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:54:35 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:54:35 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:54:35 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:54:35 user nova-compute[73007]:       <nova:owner>
Aug 15 17:54:35 user nova-compute[73007]:         <nova:user uuid="4cd910b3e8bf406f8512b3470f6eaca5">tempest-TestVolumeBootPattern-393609756-project-member</nova:user>
Aug 15 17:54:35 user nova-compute[73007]:         <nova:project uuid="c6eebca3ef0a45788b0dfbc03b01fe8c">tempest-TestVolumeBootPattern-393609756</nova:project>
Aug 15 17:54:35 user nova-compute[73007]:       </nova:owner>
Aug 15 17:54:35 user nova-compute[73007]:       <nova:ports>
Aug 15 17:54:35 user nova-compute[73007]:         <nova:port uuid="45a77f07-1a76-4b20-ad45-4e2f30e44f81">
Aug 15 17:54:35 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 17:54:35 user nova-compute[73007]:         </nova:port>
Aug 15 17:54:35 user nova-compute[73007]:       </nova:ports>
Aug 15 17:54:35 user nova-compute[73007]:     </nova:instance>
Aug 15 17:54:35 user nova-compute[73007]:   </metadata>
Aug 15 17:54:35 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:54:35 user nova-compute[73007]:     <system>
Aug 15 17:54:35 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:54:35 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:54:35 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:54:35 user nova-compute[73007]:       <entry name="serial">28635f62-bb70-454f-ab7a-c40e48ba2950</entry>
Aug 15 17:54:35 user nova-compute[73007]:       <entry name="uuid">28635f62-bb70-454f-ab7a-c40e48ba2950</entry>
Aug 15 17:54:35 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:54:35 user nova-compute[73007]:     </system>
Aug 15 17:54:35 user nova-compute[73007]:   </sysinfo>
Aug 15 17:54:35 user nova-compute[73007]:   <os>
Aug 15 17:54:35 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:54:35 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:54:35 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:54:35 user nova-compute[73007]:   </os>
Aug 15 17:54:35 user nova-compute[73007]:   <features>
Aug 15 17:54:35 user nova-compute[73007]:     <acpi/>
Aug 15 17:54:35 user nova-compute[73007]:     <apic/>
Aug 15 17:54:35 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:54:35 user nova-compute[73007]:   </features>
Aug 15 17:54:35 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:54:35 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:54:35 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:54:35 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:54:35 user nova-compute[73007]:   </clock>
Aug 15 17:54:35 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:54:35 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:54:35 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:54:35 user nova-compute[73007]:   </cpu>
Aug 15 17:54:35 user nova-compute[73007]:   <devices>
Aug 15 17:54:35 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:54:35 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:54:35 user nova-compute[73007]:       <source dev="/dev/sde"/>
Aug 15 17:54:35 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:54:35 user nova-compute[73007]:       <serial>2edbf841-b58b-42cf-875b-c211698d6208</serial>
Aug 15 17:54:35 user nova-compute[73007]:     </disk>
Aug 15 17:54:35 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:54:35 user nova-compute[73007]:       <mac address="fa:16:3e:a1:b6:a9"/>
Aug 15 17:54:35 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:35 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:54:35 user nova-compute[73007]:       <target dev="tap45a77f07-1a"/>
Aug 15 17:54:35 user nova-compute[73007]:     </interface>
Aug 15 17:54:35 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:54:35 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/28635f62-bb70-454f-ab7a-c40e48ba2950/console.log" append="off"/>
Aug 15 17:54:35 user nova-compute[73007]:     </serial>
Aug 15 17:54:35 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:54:35 user nova-compute[73007]:     <video>
Aug 15 17:54:35 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:35 user nova-compute[73007]:     </video>
Aug 15 17:54:35 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:54:35 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:54:35 user nova-compute[73007]:     </rng>
Aug 15 17:54:35 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:54:35 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:54:35 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:54:35 user nova-compute[73007]:     </memballoon>
Aug 15 17:54:35 user nova-compute[73007]:   </devices>
Aug 15 17:54:35 user nova-compute[73007]: </domain>
Aug 15 17:54:35 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-468031183',display_name='tempest-TestVolumeBootPattern-volume-backed-server-468031183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-468031183',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCeLFsG2e8bauw7/mxxyUA+2AowhFfO5TuGjjgxATqYoVhx8pEyfnHSefCAuC+Js0v/IoiaU5y+P5kAWBvbmMNjqb/c0gU3uRFkQ/gheaDk9YScOI/ODxPYZ3b6qIlTxg==',key_name='tempest-keypair-947905252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-bvcz0ig0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=28635f62-bb70-454f-ab7a-c40e48ba2950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=45a77f07-1a76-4b20-ad45-4e2f30e44f81,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a77f07-1a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG os_vif [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=45a77f07-1a76-4b20-ad45-4e2f30e44f81,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a77f07-1a') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45a77f07-1a, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45a77f07-1a, col_values=(('external_ids', {'iface-id': '45a77f07-1a76-4b20-ad45-4e2f30e44f81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:b6:a9', 'vm-uuid': '28635f62-bb70-454f-ab7a-c40e48ba2950'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:35 user nova-compute[73007]: INFO os_vif [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=45a77f07-1a76-4b20-ad45-4e2f30e44f81,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a77f07-1a')
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:54:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No VIF found with MAC fa:16:3e:a1:b6:a9, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:36 user nova-compute[73007]: INFO nova.compute.manager [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Unshelving
Aug 15 17:54:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'pci_requests' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'numa_topology' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:54:36 user nova-compute[73007]: INFO nova.compute.claims [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Claim successful on node user
Aug 15 17:54:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.715s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-2c4455d1-b1a2-4476-be3e-38c2bb269e66 req-457ca79a-0977-4a07-9dc6-4daaa9eb8d19 service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received event network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2c4455d1-b1a2-4476-be3e-38c2bb269e66 req-457ca79a-0977-4a07-9dc6-4daaa9eb8d19 service nova] Acquiring lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2c4455d1-b1a2-4476-be3e-38c2bb269e66 req-457ca79a-0977-4a07-9dc6-4daaa9eb8d19 service nova] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2c4455d1-b1a2-4476-be3e-38c2bb269e66 req-457ca79a-0977-4a07-9dc6-4daaa9eb8d19 service nova] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-2c4455d1-b1a2-4476-be3e-38c2bb269e66 req-457ca79a-0977-4a07-9dc6-4daaa9eb8d19 service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] No waiting events found dispatching network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:37 user nova-compute[73007]: WARNING nova.compute.manager [req-2c4455d1-b1a2-4476-be3e-38c2bb269e66 req-457ca79a-0977-4a07-9dc6-4daaa9eb8d19 service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received unexpected event network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 for instance with vm_state building and task_state spawning.
Aug 15 17:54:37 user nova-compute[73007]: INFO nova.network.neutron [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating port aa84c30b-91eb-44eb-8b98-b64d96aab4af with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquired lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-45ac3e9c-8416-4114-aa4a-a7a791a0e8d3 req-6512c2b0-484e-4b48-9519-030019fd3d32 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-changed-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-45ac3e9c-8416-4114-aa4a-a7a791a0e8d3 req-6512c2b0-484e-4b48-9519-030019fd3d32 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Refreshing instance network info cache due to event network-changed-aa84c30b-91eb-44eb-8b98-b64d96aab4af. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45ac3e9c-8416-4114-aa4a-a7a791a0e8d3 req-6512c2b0-484e-4b48-9519-030019fd3d32 service nova] Acquiring lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG nova.network.neutron [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Releasing lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:54:38 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Creating image(s)
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'trusted_certs' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45ac3e9c-8416-4114-aa4a-a7a791a0e8d3 req-6512c2b0-484e-4b48-9519-030019fd3d32 service nova] Acquired lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-45ac3e9c-8416-4114-aa4a-a7a791a0e8d3 req-6512c2b0-484e-4b48-9519-030019fd3d32 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Refreshing network info cache for port aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "fab8611a3cb5d3786d1590edd80984e57ccc6b14" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "fab8611a3cb5d3786d1590edd80984e57ccc6b14" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122079.188481, 28635f62-bb70-454f-ab7a-c40e48ba2950 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:40 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] VM Resumed (Lifecycle Event)
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-f34b56ec-f2f8-466c-aba2-5a133ff17b34 req-f2f52808-cea5-4726-970c-75143c5f5620 service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received event network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f34b56ec-f2f8-466c-aba2-5a133ff17b34 req-f2f52808-cea5-4726-970c-75143c5f5620 service nova] Acquiring lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f34b56ec-f2f8-466c-aba2-5a133ff17b34 req-f2f52808-cea5-4726-970c-75143c5f5620 service nova] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f34b56ec-f2f8-466c-aba2-5a133ff17b34 req-f2f52808-cea5-4726-970c-75143c5f5620 service nova] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-f34b56ec-f2f8-466c-aba2-5a133ff17b34 req-f2f52808-cea5-4726-970c-75143c5f5620 service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] No waiting events found dispatching network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:40 user nova-compute[73007]: WARNING nova.compute.manager [req-f34b56ec-f2f8-466c-aba2-5a133ff17b34 req-f2f52808-cea5-4726-970c-75143c5f5620 service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received unexpected event network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 for instance with vm_state building and task_state spawning.
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:54:40 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Instance spawned successfully.
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14.part --force-share --output=json" returned: 0 in 0.288s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.images [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] ad8381c7-fc9e-4822-a968-9dd3f74618cb was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14.part /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:40 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122079.188625, 28635f62-bb70-454f-ab7a-c40e48ba2950 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:40 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] VM Started (Lifecycle Event)
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:40 user nova-compute[73007]: INFO nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:40 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:40 user nova-compute[73007]: INFO nova.compute.manager [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Took 18.48 seconds to build instance.
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14.part /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14.converted" returned: 0 in 0.573s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.network.neutron [req-45ac3e9c-8416-4114-aa4a-a7a791a0e8d3 req-6512c2b0-484e-4b48-9519-030019fd3d32 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updated VIF entry in instance network info cache for port aa84c30b-91eb-44eb-8b98-b64d96aab4af. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG nova.network.neutron [req-45ac3e9c-8416-4114-aa4a-a7a791a0e8d3 req-6512c2b0-484e-4b48-9519-030019fd3d32 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0e00ef49-f753-4d11-8056-dea47f68adec tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.677s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45ac3e9c-8416-4114-aa4a-a7a791a0e8d3 req-6512c2b0-484e-4b48-9519-030019fd3d32 service nova] Releasing lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "fab8611a3cb5d3786d1590edd80984e57ccc6b14" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.185s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14 --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "fab8611a3cb5d3786d1590edd80984e57ccc6b14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "fab8611a3cb5d3786d1590edd80984e57ccc6b14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14 --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14,backing_fmt=raw /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14,backing_fmt=raw /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk 1073741824" returned: 0 in 0.054s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "fab8611a3cb5d3786d1590edd80984e57ccc6b14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14 --force-share --output=json" returned: 0 in 0.230s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'migration_context' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:41 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Rebasing disk image.
Aug 15 17:54:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 -F raw /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:54:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:54:43 user nova-compute[73007]: INFO nova.compute.claims [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Claim successful on node user
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:54:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.policy [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52391420381427297cc8c55600112b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba0a5fb91043d9a46323b202cd924c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:54:44 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Creating image(s)
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 -F raw /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk" returned: 0 in 2.629s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Ensure instance console log exists: /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Start _get_guest_xml network_info=[{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='470a4e996b604b86fef3378b761f34a0',container_format='bare',created_at=2023-08-15T17:52:43Z,direct_url=<?>,disk_format='qcow2',id=ad8381c7-fc9e-4822-a968-9dd3f74618cb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-232696881-shelved',owner='4727295cc556413eb5dd6ca0d10f50e7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T17:52:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:44 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:44 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='470a4e996b604b86fef3378b761f34a0',container_format='bare',created_at=2023-08-15T17:52:43Z,direct_url=<?>,disk_format='qcow2',id=ad8381c7-fc9e-4822-a968-9dd3f74618cb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-232696881-shelved',owner='4727295cc556413eb5dd6ca0d10f50e7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T17:52:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'vcpu_model' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-232696881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-232696881',id=23,image_ref='ad8381c7-fc9e-4822-a968-9dd3f74618cb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1670192498',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-rahs12xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member',shelved_at='2023-08-15T17:52:47.227278',shelved_host='user',shelved_image_id='ad8381c7-fc9e-4822-a968-9dd3f74618cb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=70146485-1eef-4e98-88d3-01f14133c3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'pci_devices' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:54:44 user nova-compute[73007]:   <uuid>70146485-1eef-4e98-88d3-01f14133c3f7</uuid>
Aug 15 17:54:44 user nova-compute[73007]:   <name>instance-00000017</name>
Aug 15 17:54:44 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:54:44 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:54:44 user nova-compute[73007]:   <metadata>
Aug 15 17:54:44 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:54:44 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:54:44 user nova-compute[73007]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-232696881</nova:name>
Aug 15 17:54:44 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:54:44</nova:creationTime>
Aug 15 17:54:44 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:54:44 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:54:44 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:54:44 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:54:44 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:54:44 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:54:44 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:54:44 user nova-compute[73007]:       <nova:owner>
Aug 15 17:54:44 user nova-compute[73007]:         <nova:user uuid="206f089e51fd4e8f842a5584b630c736">tempest-AttachVolumeShelveTestJSON-1726690631-project-member</nova:user>
Aug 15 17:54:44 user nova-compute[73007]:         <nova:project uuid="4727295cc556413eb5dd6ca0d10f50e7">tempest-AttachVolumeShelveTestJSON-1726690631</nova:project>
Aug 15 17:54:44 user nova-compute[73007]:       </nova:owner>
Aug 15 17:54:44 user nova-compute[73007]:       <nova:root type="image" uuid="ad8381c7-fc9e-4822-a968-9dd3f74618cb"/>
Aug 15 17:54:44 user nova-compute[73007]:       <nova:ports>
Aug 15 17:54:44 user nova-compute[73007]:         <nova:port uuid="aa84c30b-91eb-44eb-8b98-b64d96aab4af">
Aug 15 17:54:44 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 17:54:44 user nova-compute[73007]:         </nova:port>
Aug 15 17:54:44 user nova-compute[73007]:       </nova:ports>
Aug 15 17:54:44 user nova-compute[73007]:     </nova:instance>
Aug 15 17:54:44 user nova-compute[73007]:   </metadata>
Aug 15 17:54:44 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:54:44 user nova-compute[73007]:     <system>
Aug 15 17:54:44 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:54:44 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:54:44 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:54:44 user nova-compute[73007]:       <entry name="serial">70146485-1eef-4e98-88d3-01f14133c3f7</entry>
Aug 15 17:54:44 user nova-compute[73007]:       <entry name="uuid">70146485-1eef-4e98-88d3-01f14133c3f7</entry>
Aug 15 17:54:44 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:54:44 user nova-compute[73007]:     </system>
Aug 15 17:54:44 user nova-compute[73007]:   </sysinfo>
Aug 15 17:54:44 user nova-compute[73007]:   <os>
Aug 15 17:54:44 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:54:44 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:54:44 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:54:44 user nova-compute[73007]:   </os>
Aug 15 17:54:44 user nova-compute[73007]:   <features>
Aug 15 17:54:44 user nova-compute[73007]:     <acpi/>
Aug 15 17:54:44 user nova-compute[73007]:     <apic/>
Aug 15 17:54:44 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:54:44 user nova-compute[73007]:   </features>
Aug 15 17:54:44 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:54:44 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:54:44 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:54:44 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:54:44 user nova-compute[73007]:   </clock>
Aug 15 17:54:44 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:54:44 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:54:44 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:54:44 user nova-compute[73007]:   </cpu>
Aug 15 17:54:44 user nova-compute[73007]:   <devices>
Aug 15 17:54:44 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:54:44 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:54:44 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk"/>
Aug 15 17:54:44 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:54:44 user nova-compute[73007]:     </disk>
Aug 15 17:54:44 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:54:44 user nova-compute[73007]:       <mac address="fa:16:3e:35:27:db"/>
Aug 15 17:54:44 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:44 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:54:44 user nova-compute[73007]:       <target dev="tapaa84c30b-91"/>
Aug 15 17:54:44 user nova-compute[73007]:     </interface>
Aug 15 17:54:44 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:54:44 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/console.log" append="off"/>
Aug 15 17:54:44 user nova-compute[73007]:     </serial>
Aug 15 17:54:44 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:54:44 user nova-compute[73007]:     <video>
Aug 15 17:54:44 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:44 user nova-compute[73007]:     </video>
Aug 15 17:54:44 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:54:44 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:54:44 user nova-compute[73007]:     </rng>
Aug 15 17:54:44 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:54:44 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:54:44 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:54:44 user nova-compute[73007]:     </memballoon>
Aug 15 17:54:44 user nova-compute[73007]:   </devices>
Aug 15 17:54:44 user nova-compute[73007]: </domain>
Aug 15 17:54:44 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-232696881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-232696881',id=23,image_ref='ad8381c7-fc9e-4822-a968-9dd3f74618cb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1670192498',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-rahs12xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member',shelved_at='2023-08-15T17:52:47.227278',shelved_host='user',shelved_image_id='ad8381c7-fc9e-4822-a968-9dd3f74618cb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=70146485-1eef-4e98-88d3-01f14133c3f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG os_vif [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa84c30b-91, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa84c30b-91, col_values=(('external_ids', {'iface-id': 'aa84c30b-91eb-44eb-8b98-b64d96aab4af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:27:db', 'vm-uuid': '70146485-1eef-4e98-88d3-01f14133c3f7'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:44 user nova-compute[73007]: INFO os_vif [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91')
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] No VIF found with MAC fa:16:3e:35:27:db, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:54:44 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.318s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.267s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk 1073741824" returned: 0 in 0.066s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Successfully created port: 3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.242s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Cannot resize image /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'migration_context' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Ensure instance console log exists: /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Successfully updated port: 3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquired lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-b6c5bc1c-7d21-4b09-b714-cbb948b917cf req-acb35ac2-4865-4602-aef4-fa7082940e4f service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-changed-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-b6c5bc1c-7d21-4b09-b714-cbb948b917cf req-acb35ac2-4865-4602-aef4-fa7082940e4f service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Refreshing instance network info cache due to event network-changed-3b7b0e14-4976-4854-9b48-40afa4b5f430. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b6c5bc1c-7d21-4b09-b714-cbb948b917cf req-acb35ac2-4865-4602-aef4-fa7082940e4f service nova] Acquiring lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-d110f92f-eb75-4025-a183-0c77b022584d req-6266edf6-ee3d-4d36-b573-b03bc7e0be17 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d110f92f-eb75-4025-a183-0c77b022584d req-6266edf6-ee3d-4d36-b573-b03bc7e0be17 service nova] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d110f92f-eb75-4025-a183-0c77b022584d req-6266edf6-ee3d-4d36-b573-b03bc7e0be17 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d110f92f-eb75-4025-a183-0c77b022584d req-6266edf6-ee3d-4d36-b573-b03bc7e0be17 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-d110f92f-eb75-4025-a183-0c77b022584d req-6266edf6-ee3d-4d36-b573-b03bc7e0be17 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] No waiting events found dispatching network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:46 user nova-compute[73007]: WARNING nova.compute.manager [req-d110f92f-eb75-4025-a183-0c77b022584d req-6266edf6-ee3d-4d36-b573-b03bc7e0be17 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received unexpected event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Updating instance_info_cache with network_info: [{"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Releasing lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance network_info: |[{"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b6c5bc1c-7d21-4b09-b714-cbb948b917cf req-acb35ac2-4865-4602-aef4-fa7082940e4f service nova] Acquired lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.network.neutron [req-b6c5bc1c-7d21-4b09-b714-cbb948b917cf req-acb35ac2-4865-4602-aef4-fa7082940e4f service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Refreshing network info cache for port 3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Start _get_guest_xml network_info=[{"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:54:47 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:47 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-740136733',display_name='tempest-tempest.common.compute-instance-740136733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-740136733',id=33,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdIs/eg2C8hauxoxVn9GAyoaiKlWml9Ipd/bLniZNf2EVQLJEHP9kIsjS/Jx6/BcyOgdQkj1N/mtGmcqCV+UW+HVYjF0SpmAzPzt3hJlQgzHSNIQFR73eqoWQSg1o/Mw==',key_name='tempest-keypair-1434873340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-8h08cfb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=91cffe2e-5666-471f-a45f-1c14ea6668dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'pci_devices' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:54:47 user nova-compute[73007]:   <uuid>91cffe2e-5666-471f-a45f-1c14ea6668dd</uuid>
Aug 15 17:54:47 user nova-compute[73007]:   <name>instance-00000021</name>
Aug 15 17:54:47 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:54:47 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:54:47 user nova-compute[73007]:   <metadata>
Aug 15 17:54:47 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:54:47 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:54:47 user nova-compute[73007]:       <nova:name>tempest-tempest.common.compute-instance-740136733</nova:name>
Aug 15 17:54:47 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:54:47</nova:creationTime>
Aug 15 17:54:47 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:54:47 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:54:47 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:54:47 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:54:47 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:54:47 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:54:47 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:54:47 user nova-compute[73007]:       <nova:owner>
Aug 15 17:54:47 user nova-compute[73007]:         <nova:user uuid="d52391420381427297cc8c55600112b0">tempest-ServerActionsTestOtherA-226008880-project-member</nova:user>
Aug 15 17:54:47 user nova-compute[73007]:         <nova:project uuid="09ba0a5fb91043d9a46323b202cd924c">tempest-ServerActionsTestOtherA-226008880</nova:project>
Aug 15 17:54:47 user nova-compute[73007]:       </nova:owner>
Aug 15 17:54:47 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:54:47 user nova-compute[73007]:       <nova:ports>
Aug 15 17:54:47 user nova-compute[73007]:         <nova:port uuid="3b7b0e14-4976-4854-9b48-40afa4b5f430">
Aug 15 17:54:47 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 17:54:47 user nova-compute[73007]:         </nova:port>
Aug 15 17:54:47 user nova-compute[73007]:       </nova:ports>
Aug 15 17:54:47 user nova-compute[73007]:     </nova:instance>
Aug 15 17:54:47 user nova-compute[73007]:   </metadata>
Aug 15 17:54:47 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:54:47 user nova-compute[73007]:     <system>
Aug 15 17:54:47 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:54:47 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:54:47 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:54:47 user nova-compute[73007]:       <entry name="serial">91cffe2e-5666-471f-a45f-1c14ea6668dd</entry>
Aug 15 17:54:47 user nova-compute[73007]:       <entry name="uuid">91cffe2e-5666-471f-a45f-1c14ea6668dd</entry>
Aug 15 17:54:47 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:54:47 user nova-compute[73007]:     </system>
Aug 15 17:54:47 user nova-compute[73007]:   </sysinfo>
Aug 15 17:54:47 user nova-compute[73007]:   <os>
Aug 15 17:54:47 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:54:47 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:54:47 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:54:47 user nova-compute[73007]:   </os>
Aug 15 17:54:47 user nova-compute[73007]:   <features>
Aug 15 17:54:47 user nova-compute[73007]:     <acpi/>
Aug 15 17:54:47 user nova-compute[73007]:     <apic/>
Aug 15 17:54:47 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:54:47 user nova-compute[73007]:   </features>
Aug 15 17:54:47 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:54:47 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:54:47 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:54:47 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:54:47 user nova-compute[73007]:   </clock>
Aug 15 17:54:47 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:54:47 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:54:47 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:54:47 user nova-compute[73007]:   </cpu>
Aug 15 17:54:47 user nova-compute[73007]:   <devices>
Aug 15 17:54:47 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:54:47 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:54:47 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk"/>
Aug 15 17:54:47 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:54:47 user nova-compute[73007]:     </disk>
Aug 15 17:54:47 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:54:47 user nova-compute[73007]:       <mac address="fa:16:3e:52:42:06"/>
Aug 15 17:54:47 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:47 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:54:47 user nova-compute[73007]:       <target dev="tap3b7b0e14-49"/>
Aug 15 17:54:47 user nova-compute[73007]:     </interface>
Aug 15 17:54:47 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:54:47 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/console.log" append="off"/>
Aug 15 17:54:47 user nova-compute[73007]:     </serial>
Aug 15 17:54:47 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:54:47 user nova-compute[73007]:     <video>
Aug 15 17:54:47 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:54:47 user nova-compute[73007]:     </video>
Aug 15 17:54:47 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:54:47 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:54:47 user nova-compute[73007]:     </rng>
Aug 15 17:54:47 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:54:47 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:54:47 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:54:47 user nova-compute[73007]:     </memballoon>
Aug 15 17:54:47 user nova-compute[73007]:   </devices>
Aug 15 17:54:47 user nova-compute[73007]: </domain>
Aug 15 17:54:47 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-740136733',display_name='tempest-tempest.common.compute-instance-740136733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-740136733',id=33,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdIs/eg2C8hauxoxVn9GAyoaiKlWml9Ipd/bLniZNf2EVQLJEHP9kIsjS/Jx6/BcyOgdQkj1N/mtGmcqCV+UW+HVYjF0SpmAzPzt3hJlQgzHSNIQFR73eqoWQSg1o/Mw==',key_name='tempest-keypair-1434873340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-8h08cfb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=91cffe2e-5666-471f-a45f-1c14ea6668dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG os_vif [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b7b0e14-49, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b7b0e14-49, col_values=(('external_ids', {'iface-id': '3b7b0e14-4976-4854-9b48-40afa4b5f430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:42:06', 'vm-uuid': '91cffe2e-5666-471f-a45f-1c14ea6668dd'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:47 user nova-compute[73007]: INFO os_vif [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49')
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No VIF found with MAC fa:16:3e:52:42:06, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:54:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-b6c5bc1c-7d21-4b09-b714-cbb948b917cf req-acb35ac2-4865-4602-aef4-fa7082940e4f service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Updated VIF entry in instance network info cache for port 3b7b0e14-4976-4854-9b48-40afa4b5f430. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-b6c5bc1c-7d21-4b09-b714-cbb948b917cf req-acb35ac2-4865-4602-aef4-fa7082940e4f service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Updating instance_info_cache with network_info: [{"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Port 89f9df72-5653-4107-9de4-9919b16b7f17 binding to destination host user is already ACTIVE {{(pid=73007) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b6c5bc1c-7d21-4b09-b714-cbb948b917cf req-acb35ac2-4865-4602-aef4-fa7082940e4f service nova] Releasing lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Creating tmpfile /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/tmpp3mw6i28 to verify with other compute node that the instance is on the same shared storage. {{(pid=73007) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-e99b92bd-e62f-4516-a08d-c9d17290f9bc req-d9192000-3f7b-4cd5-b4d2-38b23717d915 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e99b92bd-e62f-4516-a08d-c9d17290f9bc req-d9192000-3f7b-4cd5-b4d2-38b23717d915 service nova] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e99b92bd-e62f-4516-a08d-c9d17290f9bc req-d9192000-3f7b-4cd5-b4d2-38b23717d915 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e99b92bd-e62f-4516-a08d-c9d17290f9bc req-d9192000-3f7b-4cd5-b4d2-38b23717d915 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-e99b92bd-e62f-4516-a08d-c9d17290f9bc req-d9192000-3f7b-4cd5-b4d2-38b23717d915 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] No waiting events found dispatching network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:48 user nova-compute[73007]: WARNING nova.compute.manager [req-e99b92bd-e62f-4516-a08d-c9d17290f9bc req-d9192000-3f7b-4cd5-b4d2-38b23717d915 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received unexpected event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 17:54:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-a04a7b30-650d-4d2b-a530-0ee0775d10d1 req-c49c89f2-fed1-4c07-8e6f-c1a38adc50c0 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a04a7b30-650d-4d2b-a530-0ee0775d10d1 req-c49c89f2-fed1-4c07-8e6f-c1a38adc50c0 service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a04a7b30-650d-4d2b-a530-0ee0775d10d1 req-c49c89f2-fed1-4c07-8e6f-c1a38adc50c0 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a04a7b30-650d-4d2b-a530-0ee0775d10d1 req-c49c89f2-fed1-4c07-8e6f-c1a38adc50c0 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.compute.manager [req-a04a7b30-650d-4d2b-a530-0ee0775d10d1 req-c49c89f2-fed1-4c07-8e6f-c1a38adc50c0 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:49 user nova-compute[73007]: WARNING nova.compute.manager [req-a04a7b30-650d-4d2b-a530-0ee0775d10d1 req-c49c89f2-fed1-4c07-8e6f-c1a38adc50c0 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state resized and task_state resize_reverting.
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122089.2009668, 70146485-1eef-4e98-88d3-01f14133c3f7 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:49 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] VM Resumed (Lifecycle Event)
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:49 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance spawned successfully.
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:49 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122089.2046437, 70146485-1eef-4e98-88d3-01f14133c3f7 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:49 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] VM Started (Lifecycle Event)
Aug 15 17:54:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:49 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1d16f776-00ec-46f3-9522-fce74d6ce89b tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.473s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:49 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance destroyed successfully.
Aug 15 17:54:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'resources' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:53:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_vif [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89f9df72-56, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:50 user nova-compute[73007]: INFO os_vif [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56')
Aug 15 17:54:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:54:50 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.045s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc94f39-a2e6-4a85-bf95-e99acab2a5b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73468c3-c62d-46ba-bb28-f34069c10f7d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:50 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:50 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:50 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:54:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:54:50 user nova-compute[73007]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:54:50 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:54:50 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:54:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115079e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[99843f41-7b79-4358-89bf-30e84b56e81a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[77651652-ce69-4474-9067-d18a9d5dcd01]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede0709e-8999-4252-b992-cff20e3bbb67]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.138s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11395be-5a17-444a-a7e5-c09de5edbd0c]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[185c656e-c39c-4801-840a-1cc5557ed295]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e49d9d-32f2-49af-bc71-fdfe4a8cb4e5]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]
Aug 15 17:54:50 user nova-compute[73007]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.
Aug 15 17:54:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a60fd-f71c-4c0d-b307-ef0bbe3f05c2]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== disconnect_volume: return (421ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:54:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:51 user nova-compute[73007]: WARNING nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state resized and task_state resize_reverting.
Aug 15 17:54:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] No waiting events found dispatching network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:51 user nova-compute[73007]: WARNING nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received unexpected event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 for instance with vm_state building and task_state spawning.
Aug 15 17:54:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] No waiting events found dispatching network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:54:51 user nova-compute[73007]: WARNING nova.compute.manager [req-c2386a8a-ed84-440a-8938-27c870267859 req-481a2135-f8fa-4374-8b87-d8b5f4f86d88 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received unexpected event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 for instance with vm_state building and task_state spawning.
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:54:51 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'migration_context' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122092.160479, 91cffe2e-5666-471f-a45f-1c14ea6668dd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] VM Resumed (Lifecycle Event)
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:54:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance spawned successfully.
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:54:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122092.1614802, 91cffe2e-5666-471f-a45f-1c14ea6668dd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:54:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] VM Started (Lifecycle Event)
Aug 15 17:54:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.613s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:54:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:54:52 user nova-compute[73007]: INFO nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Took 7.75 seconds to spawn the instance on the hypervisor.
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:54:52 user nova-compute[73007]: INFO nova.compute.manager [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Took 8.97 seconds to build instance.
Aug 15 17:54:52 user nova-compute[73007]: INFO nova.compute.manager [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Swapping old allocation on dict_keys(['2c62a5a4-d74d-43ad-a53c-fdd8c74e177d']) held by migration 92c9d9f0-f763-4c05-a6bb-bd2a6dcf26e5 for instance
Aug 15 17:54:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f4492dab-e8ee-4ddf-93cd-4ffc92cde8e6 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.127s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Overwriting current allocation {'allocations': {'2c62a5a4-d74d-43ad-a53c-fdd8c74e177d': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 39}}, 'project_id': '3d1bc8ca5f444b73ae2ccf1c29c9dee3', 'user_id': 'c04d1f1310ec43aa9b4f500267105f1d', 'consumer_generation': 1} on consumer 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:54:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG os_brick.utils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337a1a9-c4d7-4507-8667-82c61bb8b352]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d8e3a7-4516-4385-aeb9-3aef17e67352]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e8aeca-6ce3-4bf9-96dc-bee4a678ae43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3768da-552d-4a55-8e2a-49a9f8b8da4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:54:53 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:54:53 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d872a5-7aa2-4311-9ba4-865c3c93f18e]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:54:53 user nova-compute[73007]: DEBUG os_brick.utils [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:54:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:54:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Starting finish_revert_migration {{(pid=73007) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Start _get_guest_xml network_info=[{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8b23c7bd-e243-4e1d-b88a-e394e3191344', 'attached_at': '2023-08-15T17:55:04.000000', 'detached_at': '', 'volume_id': '8f4a21dd-e2fe-4302-beb7-ec9a094317f7', 'serial': '8f4a21dd-e2fe-4302-beb7-ec9a094317f7'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '4a8f51ff-d0b8-4cdf-8da3-af06e70f003f', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:55:04 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:55:04 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:55:04 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:55:04 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:55:04 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e6df86-8d21-4aee-b65d-278411da2e32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:55:04 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7203d8f6-8669-469e-b175-97476d2f7f36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7] added
Aug 15 17:55:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdb1424-0836-4ac9-adc2-02b13385462c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[37487956-325e-4c55-9a41-869a73c4dd88]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElhGBiqR {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ElhGBiqR" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1390125f-f31e-47d8-9741-fcb939abfa64]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ElhGBiqR'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a56f19-7266-4d18-8bf6-c0027fb08b9c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f216ff-6746-4376-9517-e3729b6ec6b5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f906bd-e43a-4b6d-8595-5a35030498ea (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f906bd-e43a-4b6d-8595-5a35030498ea (non-flash)
Aug 15 17:55:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f906bd-e43a-4b6d-8595-5a35030498ea (non-flash)
Aug 15 17:55:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9862bbd-901c-4e6b-be90-14b6d16cdd84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]
Aug 15 17:55:04 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.
Aug 15 17:55:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b2855-cc8c-4709-9f14-803bdc60db3e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cff358-e011-423d-857b-2d027afc27df]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f906bd-e43a-4b6d-8595-5a35030498ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f906bd-e43a-4b6d-8595-5a35030498ea (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4f906bd-e43a-4b6d-8595-5a35030498ea (non-flash)
Aug 15 17:55:04 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:55:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[543a3d18-85f6-4149-9f4b-511669aebde8]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [{"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122089.972154, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:55:04 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Stopped (Lifecycle Event)
Aug 15 17:55:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-70146485-1eef-4e98-88d3-01f14133c3f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:55:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-78f12da6-3f1d-4dd6-8264-f988284d6045 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26536666463396439', 'path': '/dev/sdf'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536666463396439', 'path': '/dev/sdf'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:53:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:55:05 user nova-compute[73007]:   <uuid>8b23c7bd-e243-4e1d-b88a-e394e3191344</uuid>
Aug 15 17:55:05 user nova-compute[73007]:   <name>instance-00000011</name>
Aug 15 17:55:05 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:55:05 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:55:05 user nova-compute[73007]:   <metadata>
Aug 15 17:55:05 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:55:05 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:55:05 user nova-compute[73007]:       <nova:name>tempest-ServerActionsTestOtherB-server-1486128635</nova:name>
Aug 15 17:55:05 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:55:04</nova:creationTime>
Aug 15 17:55:05 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:55:05 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:55:05 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:55:05 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:55:05 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:55:05 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:55:05 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:55:05 user nova-compute[73007]:       <nova:owner>
Aug 15 17:55:05 user nova-compute[73007]:         <nova:user uuid="c04d1f1310ec43aa9b4f500267105f1d">tempest-ServerActionsTestOtherB-604941371-project-member</nova:user>
Aug 15 17:55:05 user nova-compute[73007]:         <nova:project uuid="3d1bc8ca5f444b73ae2ccf1c29c9dee3">tempest-ServerActionsTestOtherB-604941371</nova:project>
Aug 15 17:55:05 user nova-compute[73007]:       </nova:owner>
Aug 15 17:55:05 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:55:05 user nova-compute[73007]:       <nova:ports>
Aug 15 17:55:05 user nova-compute[73007]:         <nova:port uuid="89f9df72-5653-4107-9de4-9919b16b7f17">
Aug 15 17:55:05 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 17:55:05 user nova-compute[73007]:         </nova:port>
Aug 15 17:55:05 user nova-compute[73007]:       </nova:ports>
Aug 15 17:55:05 user nova-compute[73007]:     </nova:instance>
Aug 15 17:55:05 user nova-compute[73007]:   </metadata>
Aug 15 17:55:05 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:55:05 user nova-compute[73007]:     <system>
Aug 15 17:55:05 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:55:05 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:55:05 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:55:05 user nova-compute[73007]:       <entry name="serial">8b23c7bd-e243-4e1d-b88a-e394e3191344</entry>
Aug 15 17:55:05 user nova-compute[73007]:       <entry name="uuid">8b23c7bd-e243-4e1d-b88a-e394e3191344</entry>
Aug 15 17:55:05 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:55:05 user nova-compute[73007]:     </system>
Aug 15 17:55:05 user nova-compute[73007]:   </sysinfo>
Aug 15 17:55:05 user nova-compute[73007]:   <os>
Aug 15 17:55:05 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:55:05 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:55:05 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:55:05 user nova-compute[73007]:   </os>
Aug 15 17:55:05 user nova-compute[73007]:   <features>
Aug 15 17:55:05 user nova-compute[73007]:     <acpi/>
Aug 15 17:55:05 user nova-compute[73007]:     <apic/>
Aug 15 17:55:05 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:55:05 user nova-compute[73007]:   </features>
Aug 15 17:55:05 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:55:05 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:55:05 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:55:05 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:55:05 user nova-compute[73007]:   </clock>
Aug 15 17:55:05 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:55:05 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:55:05 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:55:05 user nova-compute[73007]:   </cpu>
Aug 15 17:55:05 user nova-compute[73007]:   <devices>
Aug 15 17:55:05 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:55:05 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:55:05 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk"/>
Aug 15 17:55:05 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:55:05 user nova-compute[73007]:     </disk>
Aug 15 17:55:05 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:55:05 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:55:05 user nova-compute[73007]:       <source dev="/dev/sdf"/>
Aug 15 17:55:05 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:55:05 user nova-compute[73007]:       <serial>8f4a21dd-e2fe-4302-beb7-ec9a094317f7</serial>
Aug 15 17:55:05 user nova-compute[73007]:     </disk>
Aug 15 17:55:05 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:55:05 user nova-compute[73007]:       <mac address="fa:16:3e:95:7c:d9"/>
Aug 15 17:55:05 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:55:05 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:55:05 user nova-compute[73007]:       <target dev="tap89f9df72-56"/>
Aug 15 17:55:05 user nova-compute[73007]:     </interface>
Aug 15 17:55:05 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:55:05 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/console.log" append="off"/>
Aug 15 17:55:05 user nova-compute[73007]:     </serial>
Aug 15 17:55:05 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:55:05 user nova-compute[73007]:     <video>
Aug 15 17:55:05 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:55:05 user nova-compute[73007]:     </video>
Aug 15 17:55:05 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:55:05 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:55:05 user nova-compute[73007]:     </rng>
Aug 15 17:55:05 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:55:05 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:55:05 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:55:05 user nova-compute[73007]:     </memballoon>
Aug 15 17:55:05 user nova-compute[73007]:   </devices>
Aug 15 17:55:05 user nova-compute[73007]: </domain>
Aug 15 17:55:05 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:53:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG os_vif [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89f9df72-56, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89f9df72-56, col_values=(('external_ids', {'iface-id': '89f9df72-5653-4107-9de4-9919b16b7f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:7c:d9', 'vm-uuid': '8b23c7bd-e243-4e1d-b88a-e394e3191344'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:55:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:05 user nova-compute[73007]: INFO os_vif [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56')
Aug 15 17:55:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-b1cf9a68-962d-4065-8d35-3e6d60b10567 req-eee179c8-8fca-4f3f-9cc0-6b57835ef2ed service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b1cf9a68-962d-4065-8d35-3e6d60b10567 req-eee179c8-8fca-4f3f-9cc0-6b57835ef2ed service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b1cf9a68-962d-4065-8d35-3e6d60b10567 req-eee179c8-8fca-4f3f-9cc0-6b57835ef2ed service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b1cf9a68-962d-4065-8d35-3e6d60b10567 req-eee179c8-8fca-4f3f-9cc0-6b57835ef2ed service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-b1cf9a68-962d-4065-8d35-3e6d60b10567 req-eee179c8-8fca-4f3f-9cc0-6b57835ef2ed service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:55:07 user nova-compute[73007]: WARNING nova.compute.manager [req-b1cf9a68-962d-4065-8d35-3e6d60b10567 req-eee179c8-8fca-4f3f-9cc0-6b57835ef2ed service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state resized and task_state resize_reverting.
Aug 15 17:55:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-4403d123-91fd-4fd8-b600-27f9ed7ce2a9 req-cb335da1-f036-4810-b5e7-ef8837db1a9a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4403d123-91fd-4fd8-b600-27f9ed7ce2a9 req-cb335da1-f036-4810-b5e7-ef8837db1a9a service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4403d123-91fd-4fd8-b600-27f9ed7ce2a9 req-cb335da1-f036-4810-b5e7-ef8837db1a9a service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4403d123-91fd-4fd8-b600-27f9ed7ce2a9 req-cb335da1-f036-4810-b5e7-ef8837db1a9a service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-4403d123-91fd-4fd8-b600-27f9ed7ce2a9 req-cb335da1-f036-4810-b5e7-ef8837db1a9a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:55:09 user nova-compute[73007]: WARNING nova.compute.manager [req-4403d123-91fd-4fd8-b600-27f9ed7ce2a9 req-cb335da1-f036-4810-b5e7-ef8837db1a9a service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state resized and task_state resize_reverting.
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122109.628962, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:55:09 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Resumed (Lifecycle Event)
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:55:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance running successfully.
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] finish_revert_migration finished successfully. {{(pid=73007) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:55:09 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122109.6301832, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:55:09 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Started (Lifecycle Event)
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:55:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:55:09 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 17:55:09 user nova-compute[73007]: INFO nova.compute.manager [None req-2637c712-cae1-48b9-91be-4059a81e691b tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance to original state: 'active'
Aug 15 17:55:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:55:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:18 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:55:18 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=6676MB free_disk=25.196617126464844GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 590854c4-c322-4f59-8026-6f1ad3c868f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 28635f62-bb70-454f-ab7a-c40e48ba2950 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 70146485-1eef-4e98-88d3-01f14133c3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 91cffe2e-5666-471f-a45f-1c14ea6668dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:55:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:32 user nova-compute[73007]: INFO nova.compute.manager [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Terminating instance
Aug 15 17:55:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-0ce9457e-0e73-404a-a596-a3e554078835 req-9d8f6b3f-4071-49a6-a571-188b9fd52f65 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0ce9457e-0e73-404a-a596-a3e554078835 req-9d8f6b3f-4071-49a6-a571-188b9fd52f65 service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0ce9457e-0e73-404a-a596-a3e554078835 req-9d8f6b3f-4071-49a6-a571-188b9fd52f65 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0ce9457e-0e73-404a-a596-a3e554078835 req-9d8f6b3f-4071-49a6-a571-188b9fd52f65 service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-0ce9457e-0e73-404a-a596-a3e554078835 req-9d8f6b3f-4071-49a6-a571-188b9fd52f65 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:55:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-0ce9457e-0e73-404a-a596-a3e554078835 req-9d8f6b3f-4071-49a6-a571-188b9fd52f65 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-unplugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Instance destroyed successfully.
Aug 15 17:55:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lazy-loading 'resources' on Instance uuid e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1318095534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1935026486',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIvgMz7mYpX7D05Wb4MZinjT0gPxrata4a0MrGnRjy415APQIOBp9A9kgHgddReowFznukjRHIxc2JaK1t+GuWtb14Fs3FEJXbWoBXhofsNDiEYHbnLbLukZFbdXs0nXg==',key_name='tempest-keypair-1261262527',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ee8ba5df700457f9f97355fd864bece',ramdisk_id='',reservation_id='r-qcdh0wm3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1292950819',owner_user_name='tempest-ServerActionsV293TestJSON-1292950819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de582a0433c424c8f7f76d74b9abe09',uuid=e6bc8143-ca4e-40cb-a38d-0a1caec7eb61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converting VIF {"id": "e8a4549a-52c9-4091-a515-2515a704233a", "address": "fa:16:3e:d1:2d:07", "network": {"id": "b05531fa-b3bc-480a-bcbf-0feafd4330f6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-439926843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ee8ba5df700457f9f97355fd864bece", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a4549a-52", "ovs_interfaceid": "e8a4549a-52c9-4091-a515-2515a704233a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_vif [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8a4549a-52, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:55:33 user nova-compute[73007]: INFO os_vif [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2d:07,bridge_name='br-int',has_traffic_filtering=True,id=e8a4549a-52c9-4091-a515-2515a704233a,network=Network(b05531fa-b3bc-480a-bcbf-0feafd4330f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a4549a-52')
Aug 15 17:55:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMeNEvxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:55:33 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[33113090-0e5f-4405-82ee-573cd5ad3f08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a957a-e6bc-4ed5-9f0e-f5815a835740]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:55:33 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:55:33 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:55:33 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:55:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:55:33 user nova-compute[73007]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b (non-flash)
Aug 15 17:55:33 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:55:33 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:55:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7be170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01fc4f4-51f9-40a6-867b-f1f87f85d2ff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a4aefe-7672-4c34-bde5-861de2c7b997]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cfeae7-1662-4057-b3e8-b1a657dad7de]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd5b533-cec6-41d2-8ca6-1a1f97a79b4d]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d756d3f-5899-4c24-a449-40bcbc4380b6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b66075-f0d3-44b2-950c-793b18aa80cb]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260]
Aug 15 17:55:33 user nova-compute[73007]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b, portal: 172.16.0.220,3260] successful.
Aug 15 17:55:33 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e090ef5-d29e-43bf-8295-960b3b25b00b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bad5b1-63a8-4fd0-ad80-4bd6fdf23018]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] <== disconnect_volume: return (308ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:55:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Deleting instance files /opt/stack/data/nova/instances/e6bc8143-ca4e-40cb-a38d-0a1caec7eb61_del
Aug 15 17:55:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Deletion of /opt/stack/data/nova/instances/e6bc8143-ca4e-40cb-a38d-0a1caec7eb61_del complete
Aug 15 17:55:33 user nova-compute[73007]: INFO nova.compute.manager [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 15 17:55:33 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:55:33 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:55:34 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:55:34 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Took 1.15 seconds to deallocate network for instance.
Aug 15 17:55:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-463106bc-04a5-4e18-910b-735fa744109b req-1b069697-0f98-4d53-85f1-339351faf069 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-deleted-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:55:34 user nova-compute[73007]: INFO nova.compute.manager [req-463106bc-04a5-4e18-910b-735fa744109b req-1b069697-0f98-4d53-85f1-339351faf069 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Neutron deleted interface e8a4549a-52c9-4091-a515-2515a704233a; detaching it from the instance and deleting it from the info cache
Aug 15 17:55:34 user nova-compute[73007]: DEBUG nova.network.neutron [req-463106bc-04a5-4e18-910b-735fa744109b req-1b069697-0f98-4d53-85f1-339351faf069 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:55:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-463106bc-04a5-4e18-910b-735fa744109b req-1b069697-0f98-4d53-85f1-339351faf069 service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Detach interface failed, port_id=e8a4549a-52c9-4091-a515-2515a704233a, reason: Instance e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:55:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-5635dced-98a4-42fc-aa04-be9990d089c8 req-efb8c280-5d44-4683-a301-d1c9491769cd service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:55:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5635dced-98a4-42fc-aa04-be9990d089c8 req-efb8c280-5d44-4683-a301-d1c9491769cd service nova] Acquiring lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5635dced-98a4-42fc-aa04-be9990d089c8 req-efb8c280-5d44-4683-a301-d1c9491769cd service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5635dced-98a4-42fc-aa04-be9990d089c8 req-efb8c280-5d44-4683-a301-d1c9491769cd service nova] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-5635dced-98a4-42fc-aa04-be9990d089c8 req-efb8c280-5d44-4683-a301-d1c9491769cd service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] No waiting events found dispatching network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:55:34 user nova-compute[73007]: WARNING nova.compute.manager [req-5635dced-98a4-42fc-aa04-be9990d089c8 req-efb8c280-5d44-4683-a301-d1c9491769cd service nova] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Received unexpected event network-vif-plugged-e8a4549a-52c9-4091-a515-2515a704233a for instance with vm_state active and task_state deleting.
Aug 15 17:55:35 user nova-compute[73007]: INFO nova.compute.manager [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Took 0.82 seconds to detach 1 volumes for instance.
Aug 15 17:55:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Deleting volume: 8e090ef5-d29e-43bf-8295-960b3b25b00b {{(pid=73007) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 17:55:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:36 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:55:36 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:55:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:36 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Deleted allocations for instance e6bc8143-ca4e-40cb-a38d-0a1caec7eb61
Aug 15 17:55:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84dd3b4b-d189-4928-a9c4-d5af927bde0f tempest-ServerActionsV293TestJSON-1292950819 tempest-ServerActionsV293TestJSON-1292950819-project-member] Lock "e6bc8143-ca4e-40cb-a38d-0a1caec7eb61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.804s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:48 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122133.333149, e6bc8143-ca4e-40cb-a38d-0a1caec7eb61 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:55:48 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] VM Stopped (Lifecycle Event)
Aug 15 17:55:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-e2b61bd1-0161-4fa0-aa38-718ea763ccae None None] [instance: e6bc8143-ca4e-40cb-a38d-0a1caec7eb61] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:55:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-86623e7e-dab9-4440-9f2d-86dc9ce4b252 req-791dfc31-bbc1-482e-831e-bf273370e0e7 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received event network-changed-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:55:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-86623e7e-dab9-4440-9f2d-86dc9ce4b252 req-791dfc31-bbc1-482e-831e-bf273370e0e7 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Refreshing instance network info cache due to event network-changed-5540b31a-0158-4d93-a580-8b7c579e1d73. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:55:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86623e7e-dab9-4440-9f2d-86dc9ce4b252 req-791dfc31-bbc1-482e-831e-bf273370e0e7 service nova] Acquiring lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:55:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86623e7e-dab9-4440-9f2d-86dc9ce4b252 req-791dfc31-bbc1-482e-831e-bf273370e0e7 service nova] Acquired lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:55:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-86623e7e-dab9-4440-9f2d-86dc9ce4b252 req-791dfc31-bbc1-482e-831e-bf273370e0e7 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Refreshing network info cache for port 5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:55:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-86623e7e-dab9-4440-9f2d-86dc9ce4b252 req-791dfc31-bbc1-482e-831e-bf273370e0e7 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updated VIF entry in instance network info cache for port 5540b31a-0158-4d93-a580-8b7c579e1d73. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:55:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-86623e7e-dab9-4440-9f2d-86dc9ce4b252 req-791dfc31-bbc1-482e-831e-bf273370e0e7 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updating instance_info_cache with network_info: [{"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:55:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86623e7e-dab9-4440-9f2d-86dc9ce4b252 req-791dfc31-bbc1-482e-831e-bf273370e0e7 service nova] Releasing lock "refresh_cache-7b4c0965-3b9f-4be1-b46a-b6b136307536" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:55:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-34652417-6634-401f-88bd-185e27e8f281 req-ae02a64e-bd3c-4e7c-baff-bd993ab7025b service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received event network-changed-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:55:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-34652417-6634-401f-88bd-185e27e8f281 req-ae02a64e-bd3c-4e7c-baff-bd993ab7025b service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Refreshing instance network info cache due to event network-changed-6eb1c835-6362-4877-b988-855367fe8ef4. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:55:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-34652417-6634-401f-88bd-185e27e8f281 req-ae02a64e-bd3c-4e7c-baff-bd993ab7025b service nova] Acquiring lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:55:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-34652417-6634-401f-88bd-185e27e8f281 req-ae02a64e-bd3c-4e7c-baff-bd993ab7025b service nova] Acquired lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:55:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-34652417-6634-401f-88bd-185e27e8f281 req-ae02a64e-bd3c-4e7c-baff-bd993ab7025b service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Refreshing network info cache for port 6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:55:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-34652417-6634-401f-88bd-185e27e8f281 req-ae02a64e-bd3c-4e7c-baff-bd993ab7025b service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Updated VIF entry in instance network info cache for port 6eb1c835-6362-4877-b988-855367fe8ef4. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:55:51 user nova-compute[73007]: DEBUG nova.network.neutron [req-34652417-6634-401f-88bd-185e27e8f281 req-ae02a64e-bd3c-4e7c-baff-bd993ab7025b service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Updating instance_info_cache with network_info: [{"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:55:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-34652417-6634-401f-88bd-185e27e8f281 req-ae02a64e-bd3c-4e7c-baff-bd993ab7025b service nova] Releasing lock "refresh_cache-590854c4-c322-4f59-8026-6f1ad3c868f7" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:52 user nova-compute[73007]: INFO nova.compute.manager [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Attaching volume ae437327-6c93-4eb4-8814-0f1ba7f77968 to /dev/vdb
Aug 15 17:55:52 user nova-compute[73007]: DEBUG os_brick.utils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed95ff1e-1417-49b2-a1dd-360ddbfb3068]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee31547-45ab-4031-95cd-2a6afbd06ec5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[425b7930-97ac-4c93-abde-9184af38036a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ad32aa-4380-455b-bf11-9fef509396e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:55:52 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:55:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[019bff34-7b10-4998-8f14-19e59207d860]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG os_brick.utils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updating existing volume attachment record: 53a69e6f-a363-4474-a806-b47a689a53cc {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:55:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:54 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid 590854c4-c322-4f59-8026-6f1ad3c868f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:55:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:55:55 user nova-compute[73007]: INFO nova.compute.manager [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Attaching volume 9e47dca3-c20b-4b22-92bf-4321290ee483 to /dev/vdb
Aug 15 17:55:55 user nova-compute[73007]: DEBUG os_brick.utils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f1d2b3-d533-41ca-ada0-2b04afeab16b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[31296ea9-0321-4599-9ed3-832b2094e93d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34fe8e6-433e-4515-808f-3923217582de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf41e8-dcf0-4a68-ae33-30d396f572d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:55:55 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:55:55 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed2fec3-190a-4556-b3b3-b6ba367090bc]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG os_brick.utils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Updating existing volume attachment record: 3dc20507-6301-411a-8c99-7f9356b57f28 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:55:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:55:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:02 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:56:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:56:02 user nova-compute[73007]: INFO nova.compute.claims [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Claim successful on node user
Aug 15 17:56:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:56:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.policy [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea224a19a063435d98885a8831d4871f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5401402cccbc447bae758f0ad20013ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:56:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Creating image(s)
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "/opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "/opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "/opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGCBpwPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:04 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:04 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:04 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk 1073741824" returned: 0 in 0.078s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fc350a-93eb-4ba0-bb44-73c82e9bae39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:56:04 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaf34a0-c1da-40b8-bb91-f08d01d149f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968] added
Aug 15 17:56:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c860e2db-d2a9-4395-9583-c2ffb0d02fff]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5b5ed9-221e-4bfd-82b2-8ee178b4cfad]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGCBpwPX {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HGCBpwPX" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[514bf2bb-abe3-4775-9fa1-809ff0188054]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HGCBpwPX'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7d5c4e-fc01-4ee9-b07f-4da013359487]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.225s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f7f8f-6c60-4d09-bdf0-92780bcf0a15]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dde8608-403c-453e-8ffa-b544125bf4c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968, portal: 172.16.0.220,3260]
Aug 15 17:56:04 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Successfully created port: 0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[79883b13-58c3-4c3c-9bc4-6a28f3611a5e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[16efa442-dcb6-47e7-8254-7d58201d4ff9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:04 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Cannot resize image /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'migration_context' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e118bd-e11e-4049-af57-80a5a4ef1cd6]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGCBpwPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Ensure instance console log exists: /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjbhiuJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:05 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Successfully updated port: 0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquired lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-72630584-b603-426f-80fe-63e683babc15 req-10b48d1b-b9ab-446f-9b3a-0208e9177eaf service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received event network-changed-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-72630584-b603-426f-80fe-63e683babc15 req-10b48d1b-b9ab-446f-9b3a-0208e9177eaf service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Refreshing instance network info cache due to event network-changed-0d174333-6d24-437d-9d7a-83276d86714d. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-72630584-b603-426f-80fe-63e683babc15 req-10b48d1b-b9ab-446f-9b3a-0208e9177eaf service nova] Acquiring lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23064373862353464', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064373862353464', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.630s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:05 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:05 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f594797-ebd4-4488-ae6f-08abc4d51b35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:56:05 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:56:05 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:05 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:56:05 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:56:05 user nova-compute[73007]:   <serial>ae437327-6c93-4eb4-8814-0f1ba7f77968</serial>
Aug 15 17:56:05 user nova-compute[73007]: </disk>
Aug 15 17:56:05 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating instance_info_cache with network_info: [{"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0087c67d-ff51-4f10-aa44-044da2b0ad4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483] added
Aug 15 17:56:05 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Releasing lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Instance network_info: |[{"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-72630584-b603-426f-80fe-63e683babc15 req-10b48d1b-b9ab-446f-9b3a-0208e9177eaf service nova] Acquired lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.neutron [req-72630584-b603-426f-80fe-63e683babc15 req-10b48d1b-b9ab-446f-9b3a-0208e9177eaf service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Refreshing network info cache for port 0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Start _get_guest_xml network_info=[{"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ecd53d-b0a6-4a90-8c92-dc8579861828]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:05 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:56:05 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-878804793',display_name='tempest-SnapshotDataIntegrityTests-server-878804793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-878804793',id=34,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbsKi/TUn80D7VNmUGtq5O2ZndwslJrZUfEc0yJRW3DewinuFvmrt+HIdIpmfAySN//REStdKePc2qzBZCYKbaJU31kNi3xzF41LyJcKGa5URqJ1cV4Dsb1uwYePQ1Dvg==',key_name='tempest-keypair-1584995018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5401402cccbc447bae758f0ad20013ea',ramdisk_id='',reservation_id='r-m8cmkjpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1339533230',owner_user_name='tempest-SnapshotDataIntegrityTests-1339533230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea224a19a063435d98885a8831d4871f',uuid=029c5519-9937-439c-9fc7-f1bad76d26f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Converting VIF {"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:1b,bridge_name='br-int',has_traffic_filtering=True,id=0d174333-6d24-437d-9d7a-83276d86714d,network=Network(d90fd017-909d-48f1-90db-ed5d3d2f8c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d174333-6d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'pci_devices' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9cae77-8c05-4b14-802e-36a698741d14]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjbhiuJa {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:56:05 user nova-compute[73007]:   <uuid>029c5519-9937-439c-9fc7-f1bad76d26f9</uuid>
Aug 15 17:56:05 user nova-compute[73007]:   <name>instance-00000022</name>
Aug 15 17:56:05 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:56:05 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:56:05 user nova-compute[73007]:   <metadata>
Aug 15 17:56:05 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:56:05 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:56:05 user nova-compute[73007]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-878804793</nova:name>
Aug 15 17:56:05 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:56:05</nova:creationTime>
Aug 15 17:56:05 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:56:05 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:56:05 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:56:05 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:56:05 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:56:05 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:56:05 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:56:05 user nova-compute[73007]:       <nova:owner>
Aug 15 17:56:05 user nova-compute[73007]:         <nova:user uuid="ea224a19a063435d98885a8831d4871f">tempest-SnapshotDataIntegrityTests-1339533230-project-member</nova:user>
Aug 15 17:56:05 user nova-compute[73007]:         <nova:project uuid="5401402cccbc447bae758f0ad20013ea">tempest-SnapshotDataIntegrityTests-1339533230</nova:project>
Aug 15 17:56:05 user nova-compute[73007]:       </nova:owner>
Aug 15 17:56:05 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:56:05 user nova-compute[73007]:       <nova:ports>
Aug 15 17:56:05 user nova-compute[73007]:         <nova:port uuid="0d174333-6d24-437d-9d7a-83276d86714d">
Aug 15 17:56:05 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 17:56:05 user nova-compute[73007]:         </nova:port>
Aug 15 17:56:05 user nova-compute[73007]:       </nova:ports>
Aug 15 17:56:05 user nova-compute[73007]:     </nova:instance>
Aug 15 17:56:05 user nova-compute[73007]:   </metadata>
Aug 15 17:56:05 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:56:05 user nova-compute[73007]:     <system>
Aug 15 17:56:05 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:56:05 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:56:05 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:56:05 user nova-compute[73007]:       <entry name="serial">029c5519-9937-439c-9fc7-f1bad76d26f9</entry>
Aug 15 17:56:05 user nova-compute[73007]:       <entry name="uuid">029c5519-9937-439c-9fc7-f1bad76d26f9</entry>
Aug 15 17:56:05 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:56:05 user nova-compute[73007]:     </system>
Aug 15 17:56:05 user nova-compute[73007]:   </sysinfo>
Aug 15 17:56:05 user nova-compute[73007]:   <os>
Aug 15 17:56:05 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:56:05 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:56:05 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:56:05 user nova-compute[73007]:   </os>
Aug 15 17:56:05 user nova-compute[73007]:   <features>
Aug 15 17:56:05 user nova-compute[73007]:     <acpi/>
Aug 15 17:56:05 user nova-compute[73007]:     <apic/>
Aug 15 17:56:05 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:56:05 user nova-compute[73007]:   </features>
Aug 15 17:56:05 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:56:05 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:56:05 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:56:05 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:56:05 user nova-compute[73007]:   </clock>
Aug 15 17:56:05 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:56:05 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:56:05 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:56:05 user nova-compute[73007]:   </cpu>
Aug 15 17:56:05 user nova-compute[73007]:   <devices>
Aug 15 17:56:05 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:56:05 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:56:05 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk"/>
Aug 15 17:56:05 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:56:05 user nova-compute[73007]:     </disk>
Aug 15 17:56:05 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:56:05 user nova-compute[73007]:       <mac address="fa:16:3e:6b:92:1b"/>
Aug 15 17:56:05 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:56:05 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:56:05 user nova-compute[73007]:       <target dev="tap0d174333-6d"/>
Aug 15 17:56:05 user nova-compute[73007]:     </interface>
Aug 15 17:56:05 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:56:05 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/console.log" append="off"/>
Aug 15 17:56:05 user nova-compute[73007]:     </serial>
Aug 15 17:56:05 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:56:05 user nova-compute[73007]:     <video>
Aug 15 17:56:05 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:56:05 user nova-compute[73007]:     </video>
Aug 15 17:56:05 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:56:05 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:56:05 user nova-compute[73007]:     </rng>
Aug 15 17:56:05 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:56:05 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:56:05 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:56:05 user nova-compute[73007]:     </memballoon>
Aug 15 17:56:05 user nova-compute[73007]:   </devices>
Aug 15 17:56:05 user nova-compute[73007]: </domain>
Aug 15 17:56:05 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-878804793',display_name='tempest-SnapshotDataIntegrityTests-server-878804793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-878804793',id=34,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbsKi/TUn80D7VNmUGtq5O2ZndwslJrZUfEc0yJRW3DewinuFvmrt+HIdIpmfAySN//REStdKePc2qzBZCYKbaJU31kNi3xzF41LyJcKGa5URqJ1cV4Dsb1uwYePQ1Dvg==',key_name='tempest-keypair-1584995018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5401402cccbc447bae758f0ad20013ea',ramdisk_id='',reservation_id='r-m8cmkjpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1339533230',owner_user_name='tempest-SnapshotDataIntegrityTests-1339533230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea224a19a063435d98885a8831d4871f',uuid=029c5519-9937-439c-9fc7-f1bad76d26f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Converting VIF {"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:1b,bridge_name='br-int',has_traffic_filtering=True,id=0d174333-6d24-437d-9d7a-83276d86714d,network=Network(d90fd017-909d-48f1-90db-ed5d3d2f8c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d174333-6d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_vif [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:1b,bridge_name='br-int',has_traffic_filtering=True,id=0d174333-6d24-437d-9d7a-83276d86714d,network=Network(d90fd017-909d-48f1-90db-ed5d3d2f8c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d174333-6d') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d174333-6d, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d174333-6d, col_values=(('external_ids', {'iface-id': '0d174333-6d24-437d-9d7a-83276d86714d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:92:1b', 'vm-uuid': '029c5519-9937-439c-9fc7-f1bad76d26f9'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjbhiuJa" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9266bdcb-74ff-4618-a291-eac6eae21b8d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PjbhiuJa'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:05 user nova-compute[73007]: INFO os_vif [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:1b,bridge_name='br-int',has_traffic_filtering=True,id=0d174333-6d24-437d-9d7a-83276d86714d,network=Network(d90fd017-909d-48f1-90db-ed5d3d2f8c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d174333-6d')
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cd9e19-67a0-41fe-b893-92f39970a0f4]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0047d-c18d-4485-ae5b-3b77a6f26d7a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:05 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:05 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:05 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:05 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:05 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:05 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:05 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:05 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No VIF found with MAC fa:16:3e:6b:92:1b, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfffdff4-e257-485b-8a55-408870ce7a20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483, portal: 172.16.0.220,3260]
Aug 15 17:56:06 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d715577b-2476-45d9-a51f-265269597f7e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c34f58-6c0e-4f55-94b9-033b5a757a1f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 (non-flash)
Aug 15 17:56:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75c060b-77ce-417e-ae95-d2a09ad24bd0]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No VIF found with MAC fa:16:3e:d8:95:1f, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-72630584-b603-426f-80fe-63e683babc15 req-10b48d1b-b9ab-446f-9b3a-0208e9177eaf service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updated VIF entry in instance network info cache for port 0d174333-6d24-437d-9d7a-83276d86714d. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-72630584-b603-426f-80fe-63e683babc15 req-10b48d1b-b9ab-446f-9b3a-0208e9177eaf service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating instance_info_cache with network_info: [{"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-72630584-b603-426f-80fe-63e683babc15 req-10b48d1b-b9ab-446f-9b3a-0208e9177eaf service nova] Releasing lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1214fa1f-9a4e-4d03-a6fc-1e5f151ebbdd tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.693s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjbhiuJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== connect_volume: return (2013ms) {'type': 'block', 'scsi_wwn': '26638323261373235', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638323261373235', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid 590854c4-c322-4f59-8026-6f1ad3c868f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:56:07 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:07 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:56:07 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:56:07 user nova-compute[73007]:   <serial>9e47dca3-c20b-4b22-92bf-4321290ee483</serial>
Aug 15 17:56:07 user nova-compute[73007]: </disk>
Aug 15 17:56:07 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-b696d124-40d5-4389-8301-8fe504ac5afa req-1af52560-7026-44c2-a94d-2bade8643ef4 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received event network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b696d124-40d5-4389-8301-8fe504ac5afa req-1af52560-7026-44c2-a94d-2bade8643ef4 service nova] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b696d124-40d5-4389-8301-8fe504ac5afa req-1af52560-7026-44c2-a94d-2bade8643ef4 service nova] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b696d124-40d5-4389-8301-8fe504ac5afa req-1af52560-7026-44c2-a94d-2bade8643ef4 service nova] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-b696d124-40d5-4389-8301-8fe504ac5afa req-1af52560-7026-44c2-a94d-2bade8643ef4 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] No waiting events found dispatching network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:07 user nova-compute[73007]: WARNING nova.compute.manager [req-b696d124-40d5-4389-8301-8fe504ac5afa req-1af52560-7026-44c2-a94d-2bade8643ef4 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received unexpected event network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d for instance with vm_state building and task_state spawning.
Aug 15 17:56:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] No VIF found with MAC fa:16:3e:79:6d:ca, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c849580a-0834-421b-9a17-0137429ddb4a tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.821s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:09 user nova-compute[73007]: INFO nova.compute.manager [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Detaching volume 9e47dca3-c20b-4b22-92bf-4321290ee483
Aug 15 17:56:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e745a9f7-6cc4-4fc6-a3fd-c9b1c3cb5c28 req-2ad3ae23-af6c-45d5-aba5-e80b56d2b5cd service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received event network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e745a9f7-6cc4-4fc6-a3fd-c9b1c3cb5c28 req-2ad3ae23-af6c-45d5-aba5-e80b56d2b5cd service nova] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e745a9f7-6cc4-4fc6-a3fd-c9b1c3cb5c28 req-2ad3ae23-af6c-45d5-aba5-e80b56d2b5cd service nova] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e745a9f7-6cc4-4fc6-a3fd-c9b1c3cb5c28 req-2ad3ae23-af6c-45d5-aba5-e80b56d2b5cd service nova] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-e745a9f7-6cc4-4fc6-a3fd-c9b1c3cb5c28 req-2ad3ae23-af6c-45d5-aba5-e80b56d2b5cd service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] No waiting events found dispatching network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:09 user nova-compute[73007]: WARNING nova.compute.manager [req-e745a9f7-6cc4-4fc6-a3fd-c9b1c3cb5c28 req-2ad3ae23-af6c-45d5-aba5-e80b56d2b5cd service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received unexpected event network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d for instance with vm_state building and task_state spawning.
Aug 15 17:56:09 user nova-compute[73007]: INFO nova.virt.block_device [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Attempting to driver detach volume 9e47dca3-c20b-4b22-92bf-4321290ee483 from mountpoint /dev/vdb
Aug 15 17:56:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Attempting to detach device vdb from instance 590854c4-c322-4f59-8026-6f1ad3c868f7 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:56:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:56:09 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:09 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:56:09 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:56:09 user nova-compute[73007]:   <serial>9e47dca3-c20b-4b22-92bf-4321290ee483</serial>
Aug 15 17:56:09 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:56:09 user nova-compute[73007]: </disk>
Aug 15 17:56:09 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:56:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully detached device vdb from instance 590854c4-c322-4f59-8026-6f1ad3c868f7 from the persistent domain config.
Aug 15 17:56:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 590854c4-c322-4f59-8026-6f1ad3c868f7 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:56:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:56:09 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:09 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:56:09 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:56:09 user nova-compute[73007]:   <serial>9e47dca3-c20b-4b22-92bf-4321290ee483</serial>
Aug 15 17:56:09 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:56:09 user nova-compute[73007]: </disk>
Aug 15 17:56:09 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122170.2389748, 029c5519-9937-439c-9fc7-f1bad76d26f9 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:10 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] VM Resumed (Lifecycle Event)
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:56:10 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Instance spawned successfully.
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:56:10 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122170.2399383, 029c5519-9937-439c-9fc7-f1bad76d26f9 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:10 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] VM Started (Lifecycle Event)
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:56:10 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122170.419415, 590854c4-c322-4f59-8026-6f1ad3c868f7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 590854c4-c322-4f59-8026-6f1ad3c868f7 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:56:10 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully detached device vdb from instance 590854c4-c322-4f59-8026-6f1ad3c868f7 from the live domain config.
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjbhiuJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:10 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:56:10 user nova-compute[73007]: INFO nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f254cc5f-4d11-4b25-beed-e95b3a160367]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc19ab89-403d-4ab8-8fe2-494ae1cdf336]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 (non-flash)
Aug 15 17:56:10 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f116797c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c94e5a7-0d85-473e-95fd-a472ca44605d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: INFO nova.compute.manager [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Took 7.61 seconds to build instance.
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b3c8d8-df8b-4a56-8e6b-f95c5a60ac7b]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7fd308eb-9fa7-46c9-af15-de9e0e5275d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.725s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8f14ec-d13f-462f-9bf7-1471a90e9f69]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f162c2ac-333d-46d8-88f7-27b26a359cf8]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae075c3e-ec04-4e19-88bc-2ae47b9ff96a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0554dc7-00cc-486e-bd88-9a39c7586170]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483, portal: 172.16.0.220,3260]
Aug 15 17:56:10 user nova-compute[73007]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:10 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e47dca3-c20b-4b22-92bf-4321290ee483 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[05797a5b-e70c-4252-a363-94b43e1e4635]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] <== disconnect_volume: return (361ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:56:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'flavor' on Instance uuid 590854c4-c322-4f59-8026-6f1ad3c868f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-90cb8801-ca1c-47e3-8aa6-5319a6846bf2 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.055s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:11 user nova-compute[73007]: INFO nova.compute.manager [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Attaching volume 1ff87c30-9830-4c48-a02f-e3ccbf63baa1 to /dev/vdc
Aug 15 17:56:11 user nova-compute[73007]: DEBUG os_brick.utils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40897c9-c3f9-4d1d-8071-80ea2c35be9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f770f4-1e17-4cd5-8696-cdb54ab37ea7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb389a61-c1c3-4b1e-9861-3128349d00c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9cdd1-9635-4df0-b38b-5ed75d2b825d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:56:12 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3db1d1-7445-4866-992a-f50c0807d3b1]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG os_brick.utils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updating existing volume attachment record: b0bca6cf-ad1d-4126-a8c7-be664b0978b5 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-67b44d1d-9ba5-4ae1-a2b7-8506f08823f6 req-42f33785-aa77-4e97-8afb-cb92a590c0bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received event network-changed-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-67b44d1d-9ba5-4ae1-a2b7-8506f08823f6 req-42f33785-aa77-4e97-8afb-cb92a590c0bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Refreshing instance network info cache due to event network-changed-45a77f07-1a76-4b20-ad45-4e2f30e44f81. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-67b44d1d-9ba5-4ae1-a2b7-8506f08823f6 req-42f33785-aa77-4e97-8afb-cb92a590c0bc service nova] Acquiring lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-67b44d1d-9ba5-4ae1-a2b7-8506f08823f6 req-42f33785-aa77-4e97-8afb-cb92a590c0bc service nova] Acquired lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-67b44d1d-9ba5-4ae1-a2b7-8506f08823f6 req-42f33785-aa77-4e97-8afb-cb92a590c0bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Refreshing network info cache for port 45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-67b44d1d-9ba5-4ae1-a2b7-8506f08823f6 req-42f33785-aa77-4e97-8afb-cb92a590c0bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Updated VIF entry in instance network info cache for port 45a77f07-1a76-4b20-ad45-4e2f30e44f81. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-67b44d1d-9ba5-4ae1-a2b7-8506f08823f6 req-42f33785-aa77-4e97-8afb-cb92a590c0bc service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Updating instance_info_cache with network_info: [{"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-67b44d1d-9ba5-4ae1-a2b7-8506f08823f6 req-42f33785-aa77-4e97-8afb-cb92a590c0bc service nova] Releasing lock "refresh_cache-28635f62-bb70-454f-ab7a-c40e48ba2950" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:15 user nova-compute[73007]: INFO nova.compute.manager [None req-bc98b25d-cffe-49c1-92c3-394eab9b0f7f tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Unrescuing
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bc98b25d-cffe-49c1-92c3-394eab9b0f7f tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bc98b25d-cffe-49c1-92c3-394eab9b0f7f tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquired lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG nova.network.neutron [None req-bc98b25d-cffe-49c1-92c3-394eab9b0f7f tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG nova.network.neutron [None req-bc98b25d-cffe-49c1-92c3-394eab9b0f7f tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updating instance_info_cache with network_info: [{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-bc98b25d-cffe-49c1-92c3-394eab9b0f7f tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Releasing lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG nova.objects.instance [None req-bc98b25d-cffe-49c1-92c3-394eab9b0f7f tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'flavor' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-7fa1edfd-8e16-4c55-9794-e056e73bf68c req-cfa2f7df-1acc-4854-9189-cc2358188086 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7fa1edfd-8e16-4c55-9794-e056e73bf68c req-cfa2f7df-1acc-4854-9189-cc2358188086 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7fa1edfd-8e16-4c55-9794-e056e73bf68c req-cfa2f7df-1acc-4854-9189-cc2358188086 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7fa1edfd-8e16-4c55-9794-e056e73bf68c req-cfa2f7df-1acc-4854-9189-cc2358188086 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-7fa1edfd-8e16-4c55-9794-e056e73bf68c req-cfa2f7df-1acc-4854-9189-cc2358188086 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:16 user nova-compute[73007]: WARNING nova.compute.manager [req-7fa1edfd-8e16-4c55-9794-e056e73bf68c req-cfa2f7df-1acc-4854-9189-cc2358188086 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:17 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance destroyed successfully.
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:18 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:56:18 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=6800MB free_disk=25.189327239990234GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 64379e41-9e78-4389-aee2-14388d2366d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 590854c4-c322-4f59-8026-6f1ad3c868f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 28635f62-bb70-454f-ab7a-c40e48ba2950 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 70146485-1eef-4e98-88d3-01f14133c3f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 91cffe2e-5666-471f-a45f-1c14ea6668dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 029c5519-9937-439c-9fc7-f1bad76d26f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-d4da399c-06e6-4eb4-a771-8dd630a00cf1 req-d65440df-16aa-4239-b2d9-eae816c9f2b6 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d4da399c-06e6-4eb4-a771-8dd630a00cf1 req-d65440df-16aa-4239-b2d9-eae816c9f2b6 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d4da399c-06e6-4eb4-a771-8dd630a00cf1 req-d65440df-16aa-4239-b2d9-eae816c9f2b6 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d4da399c-06e6-4eb4-a771-8dd630a00cf1 req-d65440df-16aa-4239-b2d9-eae816c9f2b6 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-d4da399c-06e6-4eb4-a771-8dd630a00cf1 req-d65440df-16aa-4239-b2d9-eae816c9f2b6 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:19 user nova-compute[73007]: WARNING nova.compute.manager [req-d4da399c-06e6-4eb4-a771-8dd630a00cf1 req-d65440df-16aa-4239-b2d9-eae816c9f2b6 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:56:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:56:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.678s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:56:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for c8047564-c2ee-43f4-b423-cc9c686eabc1 due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122181.0279913, c8047564-c2ee-43f4-b423-cc9c686eabc1 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:21 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] VM Resumed (Lifecycle Event)
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-bc98b25d-cffe-49c1-92c3-394eab9b0f7f tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:56:21 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122181.0329442, c8047564-c2ee-43f4-b423-cc9c686eabc1 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:21 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] VM Started (Lifecycle Event)
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:21 user nova-compute[73007]: WARNING nova.compute.manager [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:21 user nova-compute[73007]: WARNING nova.compute.manager [req-0775f074-4793-4079-9ca4-61a4eec366d6 req-267155ae-11aa-4acf-8b70-67e2bb434436 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwvgxkps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:22 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:22 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:22 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f652c8-b3dd-45be-86a1-2dd8e08a8ead]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:56:22 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c971543-3484-4d48-ac9f-e0d678c6a0c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1] added
Aug 15 17:56:22 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d21a53-3395-4369-b249-cd590dcbaa00]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef805284-117d-461e-8550-26491b2f5400]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwvgxkps {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwvgxkps" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[17314fe1-110d-48b4-ad67-1e39d1f2e8e3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwvgxkps'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2e8cd1-14af-4b5e-992d-efd447425d65]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3484d2-e15f-40e9-9e3e-d5c2a0929006]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b857a-6266-4ce0-a9be-395dd602d88b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1, portal: 172.16.0.220,3260]
Aug 15 17:56:22 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:22 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad5c4e4-2fc8-459f-af2c-faf5bd087714]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f71cba7-4925-47e3-8844-38fe42b721ba]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)
Aug 15 17:56:22 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d4a64f-c998-4e33-aa7d-7465ed007368]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:56:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwvgxkps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26364366362336432', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364366362336432', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:56:24 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:24 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:56:24 user nova-compute[73007]:   <target dev="vdc" bus="virtio"/>
Aug 15 17:56:24 user nova-compute[73007]:   <serial>1ff87c30-9830-4c48-a02f-e3ccbf63baa1</serial>
Aug 15 17:56:24 user nova-compute[73007]: </disk>
Aug 15 17:56:24 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] No VIF found with MAC fa:16:3e:d8:95:1f, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:56:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-84b34df8-e070-463f-9b35-86d665d8a891 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.720s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:25 user nova-compute[73007]: INFO nova.compute.manager [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Detaching volume ae437327-6c93-4eb4-8814-0f1ba7f77968
Aug 15 17:56:25 user nova-compute[73007]: INFO nova.virt.block_device [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Attempting to driver detach volume ae437327-6c93-4eb4-8814-0f1ba7f77968 from mountpoint /dev/vdb
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Attempting to detach device vdb from instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:56:25 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:25 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:56:25 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:56:25 user nova-compute[73007]:   <serial>ae437327-6c93-4eb4-8814-0f1ba7f77968</serial>
Aug 15 17:56:25 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:56:25 user nova-compute[73007]: </disk>
Aug 15 17:56:25 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:56:25 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully detached device vdb from instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 from the persistent domain config.
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:56:25 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:25 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:56:25 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:56:25 user nova-compute[73007]:   <serial>ae437327-6c93-4eb4-8814-0f1ba7f77968</serial>
Aug 15 17:56:25 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:56:25 user nova-compute[73007]: </disk>
Aug 15 17:56:25 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:56:25 user nova-compute[73007]: INFO nova.compute.claims [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Claim successful on node user
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122185.9129825, 7b4c0965-3b9f-4be1-b46a-b6b136307536 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:56:25 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully detached device vdb from instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 from the live domain config.
Aug 15 17:56:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HGCBpwPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:25 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[40359e91-e0ad-4293-8f33-504b2a30de27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29a8a9f-16cc-4a42-94cf-186a2f01854f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)
Aug 15 17:56:25 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1158294790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:56:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[44431dfb-2a69-4d29-8d17-8d2ee6fe8beb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d41135a-f706-4562-ba3c-77fe0a994f42]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2278124a-56c1-4781-a7ed-bf27b2d59314]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73019c1-7d3f-4cd4-bf77-f19227146441]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[253f3080-8f2f-4f71-8296-89dfed0dd663]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3196898-51e4-4b62-8b0d-d0a074607b55]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968, portal: 172.16.0.220,3260]
Aug 15 17:56:26 user nova-compute[73007]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:26 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae437327-6c93-4eb4-8814-0f1ba7f77968 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[be08c82d-7c4d-47ff-b1c7-9881b895f23d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== disconnect_volume: return (329ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:26 user nova-compute[73007]: INFO nova.compute.manager [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Terminating instance
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-3efb43de-aef0-45da-a37f-e3a2fd71f5e6 req-2e151658-e9ad-4f0e-bb78-2592109d8839 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-unplugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3efb43de-aef0-45da-a37f-e3a2fd71f5e6 req-2e151658-e9ad-4f0e-bb78-2592109d8839 service nova] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3efb43de-aef0-45da-a37f-e3a2fd71f5e6 req-2e151658-e9ad-4f0e-bb78-2592109d8839 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3efb43de-aef0-45da-a37f-e3a2fd71f5e6 req-2e151658-e9ad-4f0e-bb78-2592109d8839 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-3efb43de-aef0-45da-a37f-e3a2fd71f5e6 req-2e151658-e9ad-4f0e-bb78-2592109d8839 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] No waiting events found dispatching network-vif-unplugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-3efb43de-aef0-45da-a37f-e3a2fd71f5e6 req-2e151658-e9ad-4f0e-bb78-2592109d8839 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-unplugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:56:26 user nova-compute[73007]: INFO nova.virt.block_device [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Booting with volume snapshot 1cee1f09-3739-47f7-848a-ae9c05b52c27 at /dev/vda
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.policy [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cd910b3e8bf406f8512b3470f6eaca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eebca3ef0a45788b0dfbc03b01fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:56:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Instance destroyed successfully.
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lazy-loading 'resources' on Instance uuid 70146485-1eef-4e98-88d3-01f14133c3f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-232696881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-232696881',id=23,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYKKn1zc7cLwaJHycfMRCUe3YnDt3y7A79ahGepGzTkEVLNObE43i0Doaok1k/oAziNKotR0bmsCoqoc2xw31+wptNoF3yFPuYZNAyQBHnj0b2/qeCEvo1w9zDfEni0Kg==',key_name='tempest-keypair-1670192498',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4727295cc556413eb5dd6ca0d10f50e7',ramdisk_id='',reservation_id='r-rahs12xf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1726690631',owner_user_name='tempest-AttachVolumeShelveTestJSON-1726690631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='206f089e51fd4e8f842a5584b630c736',uuid=70146485-1eef-4e98-88d3-01f14133c3f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converting VIF {"id": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "address": "fa:16:3e:35:27:db", "network": {"id": "601d3a30-d3f0-4abb-bdc9-61a810c8a5cd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1313718080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4727295cc556413eb5dd6ca0d10f50e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa84c30b-91", "ovs_interfaceid": "aa84c30b-91eb-44eb-8b98-b64d96aab4af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:26 user nova-compute[73007]: DEBUG os_vif [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa84c30b-91, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:27 user nova-compute[73007]: INFO os_vif [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:27:db,bridge_name='br-int',has_traffic_filtering=True,id=aa84c30b-91eb-44eb-8b98-b64d96aab4af,network=Network(601d3a30-d3f0-4abb-bdc9-61a810c8a5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa84c30b-91')
Aug 15 17:56:27 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Deleting instance files /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7_del
Aug 15 17:56:27 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Deletion of /opt/stack/data/nova/instances/70146485-1eef-4e98-88d3-01f14133c3f7_del complete
Aug 15 17:56:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:27 user nova-compute[73007]: INFO nova.compute.manager [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Took 0.81 seconds to destroy the instance on the hypervisor.
Aug 15 17:56:27 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8d062fbf-8423-413f-a3a0-9044d83c24a0 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.812s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG nova.network.neutron [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Successfully created port: e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:27 user nova-compute[73007]: INFO nova.compute.manager [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Detaching volume 1ff87c30-9830-4c48-a02f-e3ccbf63baa1
Aug 15 17:56:28 user nova-compute[73007]: INFO nova.virt.block_device [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Attempting to driver detach volume 1ff87c30-9830-4c48-a02f-e3ccbf63baa1 from mountpoint /dev/vdc
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Attempting to detach device vdc from instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:56:28 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:28 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:56:28 user nova-compute[73007]:   <target dev="vdc" bus="virtio"/>
Aug 15 17:56:28 user nova-compute[73007]:   <serial>1ff87c30-9830-4c48-a02f-e3ccbf63baa1</serial>
Aug 15 17:56:28 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 17:56:28 user nova-compute[73007]: </disk>
Aug 15 17:56:28 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:56:28 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully detached device vdc from instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 from the persistent domain config.
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:56:28 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:28 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:56:28 user nova-compute[73007]:   <target dev="vdc" bus="virtio"/>
Aug 15 17:56:28 user nova-compute[73007]:   <serial>1ff87c30-9830-4c48-a02f-e3ccbf63baa1</serial>
Aug 15 17:56:28 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 17:56:28 user nova-compute[73007]: </disk>
Aug 15 17:56:28 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Successfully updated port: e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquired lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-f80b7ed0-0dea-480d-bb68-6e18e673a58e req-95ee8014-54a2-4dc0-9cf4-2c696db82889 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received event network-changed-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-f80b7ed0-0dea-480d-bb68-6e18e673a58e req-95ee8014-54a2-4dc0-9cf4-2c696db82889 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Refreshing instance network info cache due to event network-changed-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f80b7ed0-0dea-480d-bb68-6e18e673a58e req-95ee8014-54a2-4dc0-9cf4-2c696db82889 service nova] Acquiring lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122188.500999, 7b4c0965-3b9f-4be1-b46a-b6b136307536 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:56:28 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully detached device vdc from instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 from the live domain config.
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwvgxkps', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:28 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef247df-95a1-4dbf-9ead-633824fcc6a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Took 1.42 seconds to deallocate network for instance.
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-23ce9390-7ebc-48cd-8357-a92de04d3b92 req-314f14a8-1b1f-459d-98a3-b3db0c8f9fa2 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-deleted-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:28 user nova-compute[73007]: INFO nova.compute.manager [req-23ce9390-7ebc-48cd-8357-a92de04d3b92 req-314f14a8-1b1f-459d-98a3-b3db0c8f9fa2 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Neutron deleted interface aa84c30b-91eb-44eb-8b98-b64d96aab4af; detaching it from the instance and deleting it from the info cache
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-23ce9390-7ebc-48cd-8357-a92de04d3b92 req-314f14a8-1b1f-459d-98a3-b3db0c8f9fa2 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f7558f-5011-403d-8dc5-0e427aa452bd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:28 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:28 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:28 user nova-compute[73007]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)
Aug 15 17:56:28 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:28 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:28 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:28 user nova-compute[73007]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 (non-flash)
Aug 15 17:56:28 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7be050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-23ce9390-7ebc-48cd-8357-a92de04d3b92 req-314f14a8-1b1f-459d-98a3-b3db0c8f9fa2 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Detach interface failed, port_id=aa84c30b-91eb-44eb-8b98-b64d96aab4af, reason: Instance 70146485-1eef-4e98-88d3-01f14133c3f7 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bb75dd-e03a-4466-a835-1243362585cc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2a65b2-9456-44cd-8767-79fb93b62a6d]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-c1ad6423-3c25-42be-903e-9267a77ca9c3 req-4c3153a4-1387-4d53-80d9-f8e03a366192 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c1ad6423-3c25-42be-903e-9267a77ca9c3 req-4c3153a4-1387-4d53-80d9-f8e03a366192 service nova] Acquiring lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c1ad6423-3c25-42be-903e-9267a77ca9c3 req-4c3153a4-1387-4d53-80d9-f8e03a366192 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c1ad6423-3c25-42be-903e-9267a77ca9c3 req-4c3153a4-1387-4d53-80d9-f8e03a366192 service nova] Lock "70146485-1eef-4e98-88d3-01f14133c3f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-c1ad6423-3c25-42be-903e-9267a77ca9c3 req-4c3153a4-1387-4d53-80d9-f8e03a366192 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] No waiting events found dispatching network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:28 user nova-compute[73007]: WARNING nova.compute.manager [req-c1ad6423-3c25-42be-903e-9267a77ca9c3 req-4c3153a4-1387-4d53-80d9-f8e03a366192 service nova] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Received unexpected event network-vif-plugged-aa84c30b-91eb-44eb-8b98-b64d96aab4af for instance with vm_state active and task_state deleting.
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24de102-cddb-4dec-8f7c-d7bc61e1895d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a10c33-f9b2-4517-b6d1-f8a2ceaf1f61]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f900ad39-cbc3-46de-8252-ba5a79f68e9e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24bdc7d-9f1e-4d58-8d1d-eb0e47952eb1]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1, portal: 172.16.0.220,3260]
Aug 15 17:56:28 user nova-compute[73007]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:28 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Updating instance_info_cache with network_info: [{"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Releasing lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Instance network_info: |[{"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f80b7ed0-0dea-480d-bb68-6e18e673a58e req-95ee8014-54a2-4dc0-9cf4-2c696db82889 service nova] Acquired lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-f80b7ed0-0dea-480d-bb68-6e18e673a58e req-95ee8014-54a2-4dc0-9cf4-2c696db82889 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Refreshing network info cache for port e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ff87c30-9830-4c48-a02f-e3ccbf63baa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae2d048-52af-4173-9054-9dea1214c6db]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] <== disconnect_volume: return (337ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:56:29 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:56:29 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:56:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:29 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Deleted allocations for instance 70146485-1eef-4e98-88d3-01f14133c3f7
Aug 15 17:56:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e256522d-7316-4c68-ac30-86772fc66f9d tempest-AttachVolumeShelveTestJSON-1726690631 tempest-AttachVolumeShelveTestJSON-1726690631-project-member] Lock "70146485-1eef-4e98-88d3-01f14133c3f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.959s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-f80b7ed0-0dea-480d-bb68-6e18e673a58e req-95ee8014-54a2-4dc0-9cf4-2c696db82889 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Updated VIF entry in instance network info cache for port e7f6b3eb-3814-4c7a-93f6-f69e41ee649d. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:56:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-f80b7ed0-0dea-480d-bb68-6e18e673a58e req-95ee8014-54a2-4dc0-9cf4-2c696db82889 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Updating instance_info_cache with network_info: [{"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f80b7ed0-0dea-480d-bb68-6e18e673a58e req-95ee8014-54a2-4dc0-9cf4-2c696db82889 service nova] Releasing lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:29 user nova-compute[73007]: DEBUG nova.objects.instance [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'flavor' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71ebd28b-ed59-4d7a-a201-417892706760 tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.819s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:30 user nova-compute[73007]: INFO nova.compute.manager [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Terminating instance
Aug 15 17:56:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:56:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-89aecb84-ff0a-4ddc-bf7c-46be1910b698 req-f75764f3-bb3f-4654-a930-f00b76c8e0f2 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received event network-vif-unplugged-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89aecb84-ff0a-4ddc-bf7c-46be1910b698 req-f75764f3-bb3f-4654-a930-f00b76c8e0f2 service nova] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89aecb84-ff0a-4ddc-bf7c-46be1910b698 req-f75764f3-bb3f-4654-a930-f00b76c8e0f2 service nova] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-89aecb84-ff0a-4ddc-bf7c-46be1910b698 req-f75764f3-bb3f-4654-a930-f00b76c8e0f2 service nova] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-89aecb84-ff0a-4ddc-bf7c-46be1910b698 req-f75764f3-bb3f-4654-a930-f00b76c8e0f2 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] No waiting events found dispatching network-vif-unplugged-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-89aecb84-ff0a-4ddc-bf7c-46be1910b698 req-f75764f3-bb3f-4654-a930-f00b76c8e0f2 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received event network-vif-unplugged-5540b31a-0158-4d93-a580-8b7c579e1d73 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:56:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Instance destroyed successfully.
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.objects.instance [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lazy-loading 'resources' on Instance uuid 7b4c0965-3b9f-4be1-b46a-b6b136307536 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-152438196',display_name='tempest-AttachVolumeTestJSON-server-152438196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-152438196',id=30,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLhJthOKkxQ1l2Gdxd/tdSKDRWGyAdK/WlC+g2YG2yH9DtYs5Gktedfpo/aJUDa9TPYYM95TJdn4avr/G+bQ/KR9fhuNEONI7NUwXSzMKHp5Ezq0yXzw30CXNpWN1XxQg==',key_name='tempest-keypair-996746942',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1deb9da1fb54f8b8968f01265347c48',ramdisk_id='',reservation_id='r-g9y5g2hc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1742996205',owner_user_name='tempest-AttachVolumeTestJSON-1742996205-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:54:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395246c93fc4c0dac8d95fffefd9711',uuid=7b4c0965-3b9f-4be1-b46a-b6b136307536,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converting VIF {"id": "5540b31a-0158-4d93-a580-8b7c579e1d73", "address": "fa:16:3e:d8:95:1f", "network": {"id": "72cc4268-c5ef-4eb4-ba93-33c309911f24", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1960173718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1deb9da1fb54f8b8968f01265347c48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5540b31a-01", "ovs_interfaceid": "5540b31a-0158-4d93-a580-8b7c579e1d73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:95:1f,bridge_name='br-int',has_traffic_filtering=True,id=5540b31a-0158-4d93-a580-8b7c579e1d73,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5540b31a-01') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG os_vif [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:95:1f,bridge_name='br-int',has_traffic_filtering=True,id=5540b31a-0158-4d93-a580-8b7c579e1d73,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5540b31a-01') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5540b31a-01, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:56:31 user nova-compute[73007]: INFO os_vif [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:95:1f,bridge_name='br-int',has_traffic_filtering=True,id=5540b31a-0158-4d93-a580-8b7c579e1d73,network=Network(72cc4268-c5ef-4eb4-ba93-33c309911f24),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5540b31a-01')
Aug 15 17:56:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Deleting instance files /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536_del
Aug 15 17:56:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Deletion of /opt/stack/data/nova/instances/7b4c0965-3b9f-4be1-b46a-b6b136307536_del complete
Aug 15 17:56:31 user nova-compute[73007]: INFO nova.compute.manager [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 17:56:31 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:56:31 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG os_brick.utils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0892bfe6-68ed-489a-ba91-0f956b26709f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[63671dbb-d88e-4d81-b8ac-985a3ea2d372]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc47f08-ed16-4ad5-b7b8-6fc20df674c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[75120b21-ea6a-4d9a-a893-22a4c7fa1d66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:56:32 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[46643211-5c5b-43e1-96bc-48ee4cb4a2ba]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG os_brick.utils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Updating existing volume attachment record: 11bca07d-9bdb-4d70-a855-6a5484db201d {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-af496c3e-c916-487a-86ec-e8636f48d2e6 req-8fd29922-7f95-4f79-a15c-c4e90cc64f22 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received event network-vif-deleted-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:32 user nova-compute[73007]: INFO nova.compute.manager [req-af496c3e-c916-487a-86ec-e8636f48d2e6 req-8fd29922-7f95-4f79-a15c-c4e90cc64f22 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Neutron deleted interface 5540b31a-0158-4d93-a580-8b7c579e1d73; detaching it from the instance and deleting it from the info cache
Aug 15 17:56:32 user nova-compute[73007]: DEBUG nova.network.neutron [req-af496c3e-c916-487a-86ec-e8636f48d2e6 req-8fd29922-7f95-4f79-a15c-c4e90cc64f22 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:32 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Took 0.99 seconds to deallocate network for instance.
Aug 15 17:56:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-af496c3e-c916-487a-86ec-e8636f48d2e6 req-8fd29922-7f95-4f79-a15c-c4e90cc64f22 service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Detach interface failed, port_id=5540b31a-0158-4d93-a580-8b7c579e1d73, reason: Instance 7b4c0965-3b9f-4be1-b46a-b6b136307536 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:33 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:56:33 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:56:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-6501ab5c-c946-4e60-9ef2-95db2371d370 req-7e599d8f-8ad0-4e0a-811e-f985f159283d service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received event network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6501ab5c-c946-4e60-9ef2-95db2371d370 req-7e599d8f-8ad0-4e0a-811e-f985f159283d service nova] Acquiring lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6501ab5c-c946-4e60-9ef2-95db2371d370 req-7e599d8f-8ad0-4e0a-811e-f985f159283d service nova] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6501ab5c-c946-4e60-9ef2-95db2371d370 req-7e599d8f-8ad0-4e0a-811e-f985f159283d service nova] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-6501ab5c-c946-4e60-9ef2-95db2371d370 req-7e599d8f-8ad0-4e0a-811e-f985f159283d service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] No waiting events found dispatching network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:33 user nova-compute[73007]: WARNING nova.compute.manager [req-6501ab5c-c946-4e60-9ef2-95db2371d370 req-7e599d8f-8ad0-4e0a-811e-f985f159283d service nova] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Received unexpected event network-vif-plugged-5540b31a-0158-4d93-a580-8b7c579e1d73 for instance with vm_state deleted and task_state None.
Aug 15 17:56:33 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Deleted allocations for instance 7b4c0965-3b9f-4be1-b46a-b6b136307536
Aug 15 17:56:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5af20f7b-d55a-43f2-8fba-c98bf464cb4c tempest-AttachVolumeTestJSON-1742996205 tempest-AttachVolumeTestJSON-1742996205-project-member] Lock "7b4c0965-3b9f-4be1-b46a-b6b136307536" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.496s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'flavor' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-8252ad8a-46d8-415f-a19a-dfe6ee266f6c req-039bc065-590d-4ad9-ab78-ee0844c4357a service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-changed-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-8252ad8a-46d8-415f-a19a-dfe6ee266f6c req-039bc065-590d-4ad9-ab78-ee0844c4357a service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Refreshing instance network info cache due to event network-changed-3b7b0e14-4976-4854-9b48-40afa4b5f430. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8252ad8a-46d8-415f-a19a-dfe6ee266f6c req-039bc065-590d-4ad9-ab78-ee0844c4357a service nova] Acquiring lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8252ad8a-46d8-415f-a19a-dfe6ee266f6c req-039bc065-590d-4ad9-ab78-ee0844c4357a service nova] Acquired lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-8252ad8a-46d8-415f-a19a-dfe6ee266f6c req-039bc065-590d-4ad9-ab78-ee0844c4357a service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Refreshing network info cache for port 3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:35 user nova-compute[73007]: INFO nova.compute.manager [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Attaching volume 4269b050-c1e1-4e6f-9bda-28e21f5e0f62 to /dev/vdb
Aug 15 17:56:35 user nova-compute[73007]: DEBUG os_brick.utils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabc4a2e-afba-42ac-9645-d8830834e397]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5807d8eb-7a01-46d3-bef3-c46013c190c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347f6d0-e5fb-4ddf-96e9-718068e982e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[537b5439-37d7-41b9-bcfe-0ae5b8072883]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:56:35 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666b753-e475-4afe-8cb1-138456df563d]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG os_brick.utils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Updating existing volume attachment record: 226490bf-700c-48ac-9692-4f3009432578 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-8252ad8a-46d8-415f-a19a-dfe6ee266f6c req-039bc065-590d-4ad9-ab78-ee0844c4357a service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Updated VIF entry in instance network info cache for port 3b7b0e14-4976-4854-9b48-40afa4b5f430. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-8252ad8a-46d8-415f-a19a-dfe6ee266f6c req-039bc065-590d-4ad9-ab78-ee0844c4357a service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Updating instance_info_cache with network_info: [{"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8252ad8a-46d8-415f-a19a-dfe6ee266f6c req-039bc065-590d-4ad9-ab78-ee0844c4357a service nova] Releasing lock "refresh_cache-91cffe2e-5666-471f-a45f-1c14ea6668dd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:41 user nova-compute[73007]: INFO nova.compute.manager [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Rescuing
Aug 15 17:56:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:56:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquired lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:56:41 user nova-compute[73007]: DEBUG nova.network.neutron [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:56:41 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122186.9723206, 70146485-1eef-4e98-88d3-01f14133c3f7 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:41 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] VM Stopped (Lifecycle Event)
Aug 15 17:56:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-eb3a6a0d-f220-4338-b996-f57076bac087 None None] [instance: 70146485-1eef-4e98-88d3-01f14133c3f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.network.neutron [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updating instance_info_cache with network_info: [{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Releasing lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:56:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Creating image(s)
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Ensure instance console log exists: /opt/stack/data/nova/instances/94d41039-6dd8-4e12-aea8-b57f4837f4fa/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Start _get_guest_xml network_info=[{"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T17:56:16Z,direct_url=<?>,disk_format='qcow2',id=3ef8bceb-20aa-49e4-abd8-ce5ca7fd49d2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-449251344',owner='c6eebca3ef0a45788b0dfbc03b01fe8c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T17:56:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naXGYQcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94d41039-6dd8-4e12-aea8-b57f4837f4fa', 'attached_at': '', 'detached_at': '', 'volume_id': '6170d2bf-1c30-4c04-b550-23ec51880065', 'serial': '6170d2bf-1c30-4c04-b550-23ec51880065'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '11bca07d-9bdb-4d70-a855-6a5484db201d', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:56:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:56:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T17:56:16Z,direct_url=<?>,disk_format='qcow2',id=3ef8bceb-20aa-49e4-abd8-ce5ca7fd49d2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-449251344',owner='c6eebca3ef0a45788b0dfbc03b01fe8c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T17:56:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naXGYQcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:42 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e15d25-9621-4658-ad2a-8292cda04287]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:56:42 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[35449c31-71c3-489e-995f-abbd13ce8560]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065] added
Aug 15 17:56:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe355fc-5d5d-479a-a00d-d7e59a31ee1a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1062bbff-496a-4cfb-a206-d52c610064fc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naXGYQcz {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naXGYQcz" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b71b14d-1188-4fd4-bd4b-260fa2d9c789]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'naXGYQcz'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf6ced7-dc9f-4872-97bc-42e7a9b90ea5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74589ec-889f-4ebd-bd2c-b2cfcbb0a53f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-1dc98836-1e06-4b5c-80e2-b450dec6437a req-21e5fc5e-fe99-4a99-912e-2be8f6470a16 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1dc98836-1e06-4b5c-80e2-b450dec6437a req-21e5fc5e-fe99-4a99-912e-2be8f6470a16 service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1dc98836-1e06-4b5c-80e2-b450dec6437a req-21e5fc5e-fe99-4a99-912e-2be8f6470a16 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1dc98836-1e06-4b5c-80e2-b450dec6437a req-21e5fc5e-fe99-4a99-912e-2be8f6470a16 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-1dc98836-1e06-4b5c-80e2-b450dec6437a req-21e5fc5e-fe99-4a99-912e-2be8f6470a16 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:42 user nova-compute[73007]: WARNING nova.compute.manager [req-1dc98836-1e06-4b5c-80e2-b450dec6437a req-21e5fc5e-fe99-4a99-912e-2be8f6470a16 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state active and task_state rescuing.
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fee787-f6a7-4e38-9b13-8db7812f079f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065, portal: 172.16.0.220,3260]
Aug 15 17:56:42 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cbb318-3712-468b-84dd-aaa7d23d02dd]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[549e594b-3782-47ab-ad9d-0348473db8ce]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[150c48d6-5d04-477a-b21f-f7cd2fba98bf]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naXGYQcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:56:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance destroyed successfully.
Aug 15 17:56:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Attempting rescue
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73007) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance directory exists: not creating {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 17:56:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Creating image(s)
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue" returned: 0 in 0.061s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'migration_context' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Start _get_guest_xml network_info=[{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:b7:f2:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'resources' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'numa_topology' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:43 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:56:43 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1941915722',display_name='tempest-ServerRescueNegativeTestJSON-server-1941915722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1941915722',id=27,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:52:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-daik9wph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:52:05Z,user_data=None,user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=b8628c95-e352-41e4-b7d5-af0aa9ebcb0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:b7:f2:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:b7:f2:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=9fec5233-53d4-4263-abd5-dd4e68a94c53,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec5233-53') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'pci_devices' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:56:43 user nova-compute[73007]:   <uuid>b8628c95-e352-41e4-b7d5-af0aa9ebcb0c</uuid>
Aug 15 17:56:43 user nova-compute[73007]:   <name>instance-0000001b</name>
Aug 15 17:56:43 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:56:43 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:56:43 user nova-compute[73007]:   <metadata>
Aug 15 17:56:43 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:56:43 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1941915722</nova:name>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:56:43</nova:creationTime>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:56:43 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:56:43 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:owner>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:user uuid="f886ee6939504c4b9a406cedb9a65acc">tempest-ServerRescueNegativeTestJSON-1846740548-project-member</nova:user>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:project uuid="8f94edb7a50c4e0e97ddc96c5c0028fc">tempest-ServerRescueNegativeTestJSON-1846740548</nova:project>
Aug 15 17:56:43 user nova-compute[73007]:       </nova:owner>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:ports>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:port uuid="9fec5233-53d4-4263-abd5-dd4e68a94c53">
Aug 15 17:56:43 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 17:56:43 user nova-compute[73007]:         </nova:port>
Aug 15 17:56:43 user nova-compute[73007]:       </nova:ports>
Aug 15 17:56:43 user nova-compute[73007]:     </nova:instance>
Aug 15 17:56:43 user nova-compute[73007]:   </metadata>
Aug 15 17:56:43 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:56:43 user nova-compute[73007]:     <system>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="serial">b8628c95-e352-41e4-b7d5-af0aa9ebcb0c</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="uuid">b8628c95-e352-41e4-b7d5-af0aa9ebcb0c</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:56:43 user nova-compute[73007]:     </system>
Aug 15 17:56:43 user nova-compute[73007]:   </sysinfo>
Aug 15 17:56:43 user nova-compute[73007]:   <os>
Aug 15 17:56:43 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:56:43 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:56:43 user nova-compute[73007]:   </os>
Aug 15 17:56:43 user nova-compute[73007]:   <features>
Aug 15 17:56:43 user nova-compute[73007]:     <acpi/>
Aug 15 17:56:43 user nova-compute[73007]:     <apic/>
Aug 15 17:56:43 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:56:43 user nova-compute[73007]:   </features>
Aug 15 17:56:43 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:56:43 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:56:43 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:56:43 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:56:43 user nova-compute[73007]:   </clock>
Aug 15 17:56:43 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:56:43 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:56:43 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:56:43 user nova-compute[73007]:   </cpu>
Aug 15 17:56:43 user nova-compute[73007]:   <devices>
Aug 15 17:56:43 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:56:43 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:56:43 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue"/>
Aug 15 17:56:43 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:56:43 user nova-compute[73007]:     </disk>
Aug 15 17:56:43 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:56:43 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:56:43 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk"/>
Aug 15 17:56:43 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:56:43 user nova-compute[73007]:     </disk>
Aug 15 17:56:43 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:56:43 user nova-compute[73007]:       <mac address="fa:16:3e:b7:f2:a6"/>
Aug 15 17:56:43 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:56:43 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:56:43 user nova-compute[73007]:       <target dev="tap9fec5233-53"/>
Aug 15 17:56:43 user nova-compute[73007]:     </interface>
Aug 15 17:56:43 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:56:43 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/console.log" append="off"/>
Aug 15 17:56:43 user nova-compute[73007]:     </serial>
Aug 15 17:56:43 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:56:43 user nova-compute[73007]:     <video>
Aug 15 17:56:43 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:56:43 user nova-compute[73007]:     </video>
Aug 15 17:56:43 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:56:43 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:56:43 user nova-compute[73007]:     </rng>
Aug 15 17:56:43 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:56:43 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:56:43 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:56:43 user nova-compute[73007]:     </memballoon>
Aug 15 17:56:43 user nova-compute[73007]:   </devices>
Aug 15 17:56:43 user nova-compute[73007]: </domain>
Aug 15 17:56:43 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:56:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance destroyed successfully.
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No VIF found with MAC fa:16:3e:b7:f2:a6, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23735313861383262', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735313861383262', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:56:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-515683340',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-515683340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-515683340',id=35,image_ref='3ef8bceb-20aa-49e4-abd8-ce5ca7fd49d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuWSLE3w9G16InICYteiRWznDTWKa2E3FqnTfsEO/3N9DdbjbJJ4ulsqZw6aLkiA/GIkZBEm0J9hUskZ1/N4snwQPqx74hGDF0LDIHdK5klOd2+G6Dq1a2xRsxD0wV9tA==',key_name='tempest-keypair-777160582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-078xmep0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-393609756',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:56:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=94d41039-6dd8-4e12-aea8-b57f4837f4fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:66:7e,bridge_name='br-int',has_traffic_filtering=True,id=e7f6b3eb-3814-4c7a-93f6-f69e41ee649d,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f6b3eb-38') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'pci_devices' on Instance uuid 94d41039-6dd8-4e12-aea8-b57f4837f4fa {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:56:43 user nova-compute[73007]:   <uuid>94d41039-6dd8-4e12-aea8-b57f4837f4fa</uuid>
Aug 15 17:56:43 user nova-compute[73007]:   <name>instance-00000023</name>
Aug 15 17:56:43 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:56:43 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:56:43 user nova-compute[73007]:   <metadata>
Aug 15 17:56:43 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:56:43 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-515683340</nova:name>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:56:42</nova:creationTime>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:56:43 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:56:43 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:owner>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:user uuid="4cd910b3e8bf406f8512b3470f6eaca5">tempest-TestVolumeBootPattern-393609756-project-member</nova:user>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:project uuid="c6eebca3ef0a45788b0dfbc03b01fe8c">tempest-TestVolumeBootPattern-393609756</nova:project>
Aug 15 17:56:43 user nova-compute[73007]:       </nova:owner>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:root type="image" uuid="3ef8bceb-20aa-49e4-abd8-ce5ca7fd49d2"/>
Aug 15 17:56:43 user nova-compute[73007]:       <nova:ports>
Aug 15 17:56:43 user nova-compute[73007]:         <nova:port uuid="e7f6b3eb-3814-4c7a-93f6-f69e41ee649d">
Aug 15 17:56:43 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 17:56:43 user nova-compute[73007]:         </nova:port>
Aug 15 17:56:43 user nova-compute[73007]:       </nova:ports>
Aug 15 17:56:43 user nova-compute[73007]:     </nova:instance>
Aug 15 17:56:43 user nova-compute[73007]:   </metadata>
Aug 15 17:56:43 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:56:43 user nova-compute[73007]:     <system>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="serial">94d41039-6dd8-4e12-aea8-b57f4837f4fa</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="uuid">94d41039-6dd8-4e12-aea8-b57f4837f4fa</entry>
Aug 15 17:56:43 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:56:43 user nova-compute[73007]:     </system>
Aug 15 17:56:43 user nova-compute[73007]:   </sysinfo>
Aug 15 17:56:43 user nova-compute[73007]:   <os>
Aug 15 17:56:43 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:56:43 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:56:43 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:56:43 user nova-compute[73007]:   </os>
Aug 15 17:56:43 user nova-compute[73007]:   <features>
Aug 15 17:56:43 user nova-compute[73007]:     <acpi/>
Aug 15 17:56:43 user nova-compute[73007]:     <apic/>
Aug 15 17:56:43 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:56:43 user nova-compute[73007]:   </features>
Aug 15 17:56:43 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:56:43 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:56:43 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:56:43 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:56:43 user nova-compute[73007]:   </clock>
Aug 15 17:56:43 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:56:43 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:56:43 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:56:43 user nova-compute[73007]:   </cpu>
Aug 15 17:56:43 user nova-compute[73007]:   <devices>
Aug 15 17:56:43 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:56:43 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:43 user nova-compute[73007]:       <source dev="/dev/sdb"/>
Aug 15 17:56:43 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:56:43 user nova-compute[73007]:       <serial>6170d2bf-1c30-4c04-b550-23ec51880065</serial>
Aug 15 17:56:43 user nova-compute[73007]:     </disk>
Aug 15 17:56:43 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:56:43 user nova-compute[73007]:       <mac address="fa:16:3e:6c:66:7e"/>
Aug 15 17:56:43 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:56:43 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:56:43 user nova-compute[73007]:       <target dev="tape7f6b3eb-38"/>
Aug 15 17:56:43 user nova-compute[73007]:     </interface>
Aug 15 17:56:43 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:56:43 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/94d41039-6dd8-4e12-aea8-b57f4837f4fa/console.log" append="off"/>
Aug 15 17:56:43 user nova-compute[73007]:     </serial>
Aug 15 17:56:43 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:56:43 user nova-compute[73007]:     <video>
Aug 15 17:56:43 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:56:43 user nova-compute[73007]:     </video>
Aug 15 17:56:43 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:56:43 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:56:43 user nova-compute[73007]:     </rng>
Aug 15 17:56:43 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:56:43 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:56:43 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:56:43 user nova-compute[73007]:     </memballoon>
Aug 15 17:56:43 user nova-compute[73007]:   </devices>
Aug 15 17:56:43 user nova-compute[73007]: </domain>
Aug 15 17:56:43 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:56:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-515683340',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-515683340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-515683340',id=35,image_ref='3ef8bceb-20aa-49e4-abd8-ce5ca7fd49d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuWSLE3w9G16InICYteiRWznDTWKa2E3FqnTfsEO/3N9DdbjbJJ4ulsqZw6aLkiA/GIkZBEm0J9hUskZ1/N4snwQPqx74hGDF0LDIHdK5klOd2+G6Dq1a2xRsxD0wV9tA==',key_name='tempest-keypair-777160582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-078xmep0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-393609756',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:56:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=94d41039-6dd8-4e12-aea8-b57f4837f4fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:66:7e,bridge_name='br-int',has_traffic_filtering=True,id=e7f6b3eb-3814-4c7a-93f6-f69e41ee649d,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f6b3eb-38') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG os_vif [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:66:7e,bridge_name='br-int',has_traffic_filtering=True,id=e7f6b3eb-3814-4c7a-93f6-f69e41ee649d,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f6b3eb-38') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7f6b3eb-38, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7f6b3eb-38, col_values=(('external_ids', {'iface-id': 'e7f6b3eb-3814-4c7a-93f6-f69e41ee649d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:66:7e', 'vm-uuid': '94d41039-6dd8-4e12-aea8-b57f4837f4fa'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:56:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:44 user nova-compute[73007]: INFO os_vif [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:66:7e,bridge_name='br-int',has_traffic_filtering=True,id=e7f6b3eb-3814-4c7a-93f6-f69e41ee649d,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f6b3eb-38')
Aug 15 17:56:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No VIF found with MAC fa:16:3e:6c:66:7e, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:56:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-fac60ea3-4adc-471a-b32d-918c9ba1afe3 req-e283623a-2e10-49c5-af0b-c080f3daea04 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fac60ea3-4adc-471a-b32d-918c9ba1afe3 req-e283623a-2e10-49c5-af0b-c080f3daea04 service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fac60ea3-4adc-471a-b32d-918c9ba1afe3 req-e283623a-2e10-49c5-af0b-c080f3daea04 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fac60ea3-4adc-471a-b32d-918c9ba1afe3 req-e283623a-2e10-49c5-af0b-c080f3daea04 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-fac60ea3-4adc-471a-b32d-918c9ba1afe3 req-e283623a-2e10-49c5-af0b-c080f3daea04 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:44 user nova-compute[73007]: WARNING nova.compute.manager [req-fac60ea3-4adc-471a-b32d-918c9ba1afe3 req-e283623a-2e10-49c5-af0b-c080f3daea04 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state active and task_state rescuing.
Aug 15 17:56:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzbCoqJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:45 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:45 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:45 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[71442589-1da6-4def-bf21-558acc17c183]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:56:45 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[980756d3-8844-44c1-8a30-bd2fa5007a32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62] added
Aug 15 17:56:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd3034a-1ce1-47e0-8286-c1756a96e98e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94865cc-8f01-45f4-b5ad-99d24e51085e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzbCoqJy {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzbCoqJy" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd7e29-1799-463b-9a3a-02d44237e69e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IzbCoqJy'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a78de75-ec28-4fd7-8d92-86c66fe80287]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6753afe2-da7f-44a4-9c93-a867ce5b01ba]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[76157b25-6052-4d35-b718-d16ebd9e7a91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260]
Aug 15 17:56:45 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f070367-ea58-4467-9451-1e035fb0e458]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f7b08-5784-4245-bdf1-40919cb3e94e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:56:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0a9751-94b3-4a82-932f-bed455cb6f82]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-e33dfc5d-bde0-473f-a156-83cd133cc601 req-a46bb09d-ae70-4c50-a80a-1f0793a440a5 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received event network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e33dfc5d-bde0-473f-a156-83cd133cc601 req-a46bb09d-ae70-4c50-a80a-1f0793a440a5 service nova] Acquiring lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e33dfc5d-bde0-473f-a156-83cd133cc601 req-a46bb09d-ae70-4c50-a80a-1f0793a440a5 service nova] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e33dfc5d-bde0-473f-a156-83cd133cc601 req-a46bb09d-ae70-4c50-a80a-1f0793a440a5 service nova] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-e33dfc5d-bde0-473f-a156-83cd133cc601 req-a46bb09d-ae70-4c50-a80a-1f0793a440a5 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] No waiting events found dispatching network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:46 user nova-compute[73007]: WARNING nova.compute.manager [req-e33dfc5d-bde0-473f-a156-83cd133cc601 req-a46bb09d-ae70-4c50-a80a-1f0793a440a5 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received unexpected event network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d for instance with vm_state building and task_state spawning.
Aug 15 17:56:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122191.6150215, 7b4c0965-3b9f-4be1-b46a-b6b136307536 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:46 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] VM Stopped (Lifecycle Event)
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0cd3f45a-1e44-4dc6-ba2e-459b02bcf58a None None] [instance: 7b4c0965-3b9f-4be1-b46a-b6b136307536] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:46 user nova-compute[73007]: WARNING nova.compute.manager [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state active and task_state rescuing.
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.compute.manager [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:46 user nova-compute[73007]: WARNING nova.compute.manager [req-3d43a906-12e1-44ad-984b-fa972d55b954 req-8967d2ba-bf68-4e72-8f4c-66ebd2827b9c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state active and task_state rescuing.
Aug 15 17:56:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzbCoqJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23533616461376331', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533616461376331', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'flavor' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:56:46 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:46 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:56:46 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:56:46 user nova-compute[73007]:   <serial>4269b050-c1e1-4e6f-9bda-28e21f5e0f62</serial>
Aug 15 17:56:46 user nova-compute[73007]: </disk>
Aug 15 17:56:46 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:56:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:56:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No VIF found with MAC fa:16:3e:52:42:06, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:56:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6d7a290e-f7d5-4923-bb8d-f64f83b59233 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.192s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-45665960-aa0f-4b1a-ab7f-f006837e5d22 req-ff7bcada-bc06-40d5-b26a-3b47c1982aae service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received event network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45665960-aa0f-4b1a-ab7f-f006837e5d22 req-ff7bcada-bc06-40d5-b26a-3b47c1982aae service nova] Acquiring lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45665960-aa0f-4b1a-ab7f-f006837e5d22 req-ff7bcada-bc06-40d5-b26a-3b47c1982aae service nova] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-45665960-aa0f-4b1a-ab7f-f006837e5d22 req-ff7bcada-bc06-40d5-b26a-3b47c1982aae service nova] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-45665960-aa0f-4b1a-ab7f-f006837e5d22 req-ff7bcada-bc06-40d5-b26a-3b47c1982aae service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] No waiting events found dispatching network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:48 user nova-compute[73007]: WARNING nova.compute.manager [req-45665960-aa0f-4b1a-ab7f-f006837e5d22 req-ff7bcada-bc06-40d5-b26a-3b47c1982aae service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received unexpected event network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d for instance with vm_state building and task_state spawning.
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122208.7439957, 94d41039-6dd8-4e12-aea8-b57f4837f4fa => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] VM Resumed (Lifecycle Event)
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Instance spawned successfully.
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-23a4429a-6b6d-4bac-b3a0-c7f5bc76adee tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122208.7496486, 94d41039-6dd8-4e12-aea8-b57f4837f4fa => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] VM Started (Lifecycle Event)
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Took 6.49 seconds to spawn the instance on the hypervisor.
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for b8628c95-e352-41e4-b7d5-af0aa9ebcb0c due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122208.7570858, b8628c95-e352-41e4-b7d5-af0aa9ebcb0c => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] VM Resumed (Lifecycle Event)
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:56:48 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122208.7571883, b8628c95-e352-41e4-b7d5-af0aa9ebcb0c => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] VM Started (Lifecycle Event)
Aug 15 17:56:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:48 user nova-compute[73007]: INFO nova.compute.manager [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Took 23.12 seconds to build instance.
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-03a54242-e79b-4d33-9515-0d75f8f3135f tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.229s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:49 user nova-compute[73007]: INFO nova.compute.manager [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Rebuilding instance
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'trusted_certs' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'pci_requests' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'pci_devices' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'resources' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'migration_context' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG nova.objects.instance [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73007) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:50 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance destroyed successfully.
Aug 15 17:56:50 user nova-compute[73007]: INFO nova.compute.manager [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Detaching volume 4269b050-c1e1-4e6f-9bda-28e21f5e0f62
Aug 15 17:56:50 user nova-compute[73007]: INFO nova.virt.block_device [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Attempting to driver detach volume 4269b050-c1e1-4e6f-9bda-28e21f5e0f62 from mountpoint /dev/vdb
Aug 15 17:56:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Attempting to detach device vdb from instance 91cffe2e-5666-471f-a45f-1c14ea6668dd from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:56:50 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:56:50 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:56:50 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:56:50 user nova-compute[73007]:   <serial>4269b050-c1e1-4e6f-9bda-28e21f5e0f62</serial>
Aug 15 17:56:50 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:56:50 user nova-compute[73007]: </disk>
Aug 15 17:56:50 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:56:50 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully detached device vdb from instance 91cffe2e-5666-471f-a45f-1c14ea6668dd from the persistent domain config.
Aug 15 17:56:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzbCoqJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:50 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d250c-a5de-4802-a45e-8a3669d1e33e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-unplugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] No waiting events found dispatching network-vif-unplugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:50 user nova-compute[73007]: WARNING nova.compute.manager [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received unexpected event network-vif-unplugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 for instance with vm_state active and task_state rebuilding.
Aug 15 17:56:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] No waiting events found dispatching network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:50 user nova-compute[73007]: WARNING nova.compute.manager [req-c40fb76f-b5aa-4590-8ef8-465c9e9164df req-45f0d885-064b-474e-83b0-b668e30a075b service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received unexpected event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 for instance with vm_state active and task_state rebuilding.
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[307ab5e8-239f-41f8-a675-ee2f77ce16b3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:56:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11501543a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[854f8d22-d8bb-48c4-abe2-340889e385bf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5492cf1e-2ef2-4ab4-b460-ccc65cd5ced8]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b323dd6-da5c-487d-8c6a-dd67b80476c4]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e298e-b6a6-4a27-8f05-8a5b7a7fd570]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a211e76-233a-4aa5-b516-563fc0e966f6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9279e259-4a1f-48fc-9126-35f74cc52547]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260]
Aug 15 17:56:50 user nova-compute[73007]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260] successful.
Aug 15 17:56:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc0f02e-4a6a-4648-a114-4e3ee4fc0d80]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== disconnect_volume: return (337ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:56:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance destroyed successfully.
Aug 15 17:56:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-740136733',display_name='tempest-ServerActionsTestOtherA-server-1710520802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-740136733',id=33,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdIs/eg2C8hauxoxVn9GAyoaiKlWml9Ipd/bLniZNf2EVQLJEHP9kIsjS/Jx6/BcyOgdQkj1N/mtGmcqCV+UW+HVYjF0SpmAzPzt3hJlQgzHSNIQFR73eqoWQSg1o/Mw==',key_name='tempest-keypair-1434873340',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-8h08cfb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=91cffe2e-5666-471f-a45f-1c14ea6668dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_vif [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b7b0e14-49, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:56:51 user nova-compute[73007]: INFO os_vif [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49')
Aug 15 17:56:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzbCoqJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:51 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62fc49e-b339-4957-affe-84496d8ddff3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97c5bd-d402-4bd8-bfdf-b7ddea5a818b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:51 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:51 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:51 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:51 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:56:51 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:56:51 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:56:51 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:56:51 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1150155120>, {}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Disconnecting from: [] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== disconnect_volume: return (68ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:56:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Deleting instance files /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd_del
Aug 15 17:56:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Deletion of /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd_del complete
Aug 15 17:56:52 user nova-compute[73007]: INFO nova.virt.block_device [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Booting with volume 4269b050-c1e1-4e6f-9bda-28e21f5e0f62 at /dev/vdb
Aug 15 17:56:52 user nova-compute[73007]: DEBUG os_brick.utils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[38783e74-c9dd-4d93-8135-9f828d216688]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed786b9-b28d-4f84-8368-14b61ad79a18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de69a0ac-4195-4fa6-ad00-57c4c4a80726]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2afcda-2f7f-42d4-8e45-56f0e9d80112]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:56:52 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:56:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf78c786-8f41-4254-bb32-7726f0610aad]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG os_brick.utils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Updating existing volume attachment record: e2a05b98-6dde-43ac-9e16-1c4e00fbcb62 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:56:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "64379e41-9e78-4389-aee2-14388d2366d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "64379e41-9e78-4389-aee2-14388d2366d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "64379e41-9e78-4389-aee2-14388d2366d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:57 user nova-compute[73007]: INFO nova.compute.manager [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Terminating instance
Aug 15 17:56:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:58 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Instance destroyed successfully.
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.objects.instance [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lazy-loading 'resources' on Instance uuid 64379e41-9e78-4389-aee2-14388d2366d5 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1138190980',display_name='tempest-ServersNegativeTestJSON-server-1138190980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1138190980',id=16,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:48:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b56c9a439844149abcefe8703cdc906',ramdisk_id='',reservation_id='r-cxmmgf55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1246805643',owner_user_name='tempest-ServersNegativeTestJSON-1246805643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:48:09Z,user_data=None,user_id='f02af903ce234948b57be7978398f8e8',uuid=64379e41-9e78-4389-aee2-14388d2366d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converting VIF {"id": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "address": "fa:16:3e:7b:3a:77", "network": {"id": "13357ef9-8552-410f-9c9a-99e50bab2418", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1436486203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b56c9a439844149abcefe8703cdc906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ee70d-90", "ovs_interfaceid": "350ee70d-90af-4550-a1d3-32b0b38a4e6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:77,bridge_name='br-int',has_traffic_filtering=True,id=350ee70d-90af-4550-a1d3-32b0b38a4e6d,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350ee70d-90') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG os_vif [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:77,bridge_name='br-int',has_traffic_filtering=True,id=350ee70d-90af-4550-a1d3-32b0b38a4e6d,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350ee70d-90') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350ee70d-90, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:56:58 user nova-compute[73007]: INFO os_vif [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:77,bridge_name='br-int',has_traffic_filtering=True,id=350ee70d-90af-4550-a1d3-32b0b38a4e6d,network=Network(13357ef9-8552-410f-9c9a-99e50bab2418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350ee70d-90')
Aug 15 17:56:58 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Deleting instance files /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5_del
Aug 15 17:56:58 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Deletion of /opt/stack/data/nova/instances/64379e41-9e78-4389-aee2-14388d2366d5_del complete
Aug 15 17:56:58 user nova-compute[73007]: INFO nova.compute.manager [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 15 17:56:58 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-b97c29a2-433c-42a9-88e6-c34013f12dd6 req-1b3839db-592f-4bdd-96af-1447891d86d1 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received event network-vif-unplugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97c29a2-433c-42a9-88e6-c34013f12dd6 req-1b3839db-592f-4bdd-96af-1447891d86d1 service nova] Acquiring lock "64379e41-9e78-4389-aee2-14388d2366d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97c29a2-433c-42a9-88e6-c34013f12dd6 req-1b3839db-592f-4bdd-96af-1447891d86d1 service nova] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97c29a2-433c-42a9-88e6-c34013f12dd6 req-1b3839db-592f-4bdd-96af-1447891d86d1 service nova] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-b97c29a2-433c-42a9-88e6-c34013f12dd6 req-1b3839db-592f-4bdd-96af-1447891d86d1 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] No waiting events found dispatching network-vif-unplugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-b97c29a2-433c-42a9-88e6-c34013f12dd6 req-1b3839db-592f-4bdd-96af-1447891d86d1 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received event network-vif-unplugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-59642372-2a15-4591-91df-a727f3aac3c2 req-360eda6c-5e8f-49e5-aa54-e6b68e8f8faa service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received event network-vif-deleted-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:56:58 user nova-compute[73007]: INFO nova.compute.manager [req-59642372-2a15-4591-91df-a727f3aac3c2 req-360eda6c-5e8f-49e5-aa54-e6b68e8f8faa service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Neutron deleted interface 350ee70d-90af-4550-a1d3-32b0b38a4e6d; detaching it from the instance and deleting it from the info cache
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.network.neutron [req-59642372-2a15-4591-91df-a727f3aac3c2 req-360eda6c-5e8f-49e5-aa54-e6b68e8f8faa service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:56:58 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Took 0.60 seconds to deallocate network for instance.
Aug 15 17:56:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-59642372-2a15-4591-91df-a727f3aac3c2 req-360eda6c-5e8f-49e5-aa54-e6b68e8f8faa service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Detach interface failed, port_id=350ee70d-90af-4550-a1d3-32b0b38a4e6d, reason: Instance 64379e41-9e78-4389-aee2-14388d2366d5 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:56:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:56:59 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:56:59 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:56:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:56:59 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Deleted allocations for instance 64379e41-9e78-4389-aee2-14388d2366d5
Aug 15 17:56:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1bdc41b-8ed2-4d01-bee6-4bbbf1c7693d tempest-ServersNegativeTestJSON-1246805643 tempest-ServersNegativeTestJSON-1246805643-project-member] Lock "64379e41-9e78-4389-aee2-14388d2366d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.963s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:00 user nova-compute[73007]: INFO nova.compute.manager [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Terminating instance
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received event network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] Acquiring lock "64379e41-9e78-4389-aee2-14388d2366d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] Lock "64379e41-9e78-4389-aee2-14388d2366d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] No waiting events found dispatching network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:57:00 user nova-compute[73007]: WARNING nova.compute.manager [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Received unexpected event network-vif-plugged-350ee70d-90af-4550-a1d3-32b0b38a4e6d for instance with vm_state deleted and task_state None.
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received event network-vif-unplugged-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] No waiting events found dispatching network-vif-unplugged-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ae021e68-0627-4d78-aabf-91d053d65b67 req-83841341-441f-40ff-a6f7-7c578f0d2496 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received event network-vif-unplugged-6eb1c835-6362-4877-b988-855367fe8ef4 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:57:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Instance destroyed successfully.
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.objects.instance [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lazy-loading 'resources' on Instance uuid 590854c4-c322-4f59-8026-6f1ad3c868f7 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1676257365',display_name='tempest-AttachVolumeNegativeTest-server-1676257365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1676257365',id=31,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS6OD1HGEIYe1ounZO5mgIfzoh2y0RWhnYDW8phQY9teDOh+YhfIVsjqxTKAzG99p17xH/ng+MX8RN+ya/55jDQ+QisOIiMIemwH3H+HZm8zZxmXMDQ54nMJDgmNzeozw==',key_name='tempest-keypair-211117878',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bfa702dd2884da4b28a84db913819b6',ramdisk_id='',reservation_id='r-0c42mzmt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1698859108',owner_user_name='tempest-AttachVolumeNegativeTest-1698859108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82906484a46f4ad0be9a602aec2affb6',uuid=590854c4-c322-4f59-8026-6f1ad3c868f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converting VIF {"id": "6eb1c835-6362-4877-b988-855367fe8ef4", "address": "fa:16:3e:79:6d:ca", "network": {"id": "6b61392e-5fd5-4dc5-a67d-ad65412fa321", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1719361370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bfa702dd2884da4b28a84db913819b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eb1c835-63", "ovs_interfaceid": "6eb1c835-6362-4877-b988-855367fe8ef4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:6d:ca,bridge_name='br-int',has_traffic_filtering=True,id=6eb1c835-6362-4877-b988-855367fe8ef4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb1c835-63') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG os_vif [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:6d:ca,bridge_name='br-int',has_traffic_filtering=True,id=6eb1c835-6362-4877-b988-855367fe8ef4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb1c835-63') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eb1c835-63, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:57:00 user nova-compute[73007]: INFO os_vif [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:6d:ca,bridge_name='br-int',has_traffic_filtering=True,id=6eb1c835-6362-4877-b988-855367fe8ef4,network=Network(6b61392e-5fd5-4dc5-a67d-ad65412fa321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6eb1c835-63')
Aug 15 17:57:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Deleting instance files /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7_del
Aug 15 17:57:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Deletion of /opt/stack/data/nova/instances/590854c4-c322-4f59-8026-6f1ad3c868f7_del complete
Aug 15 17:57:01 user nova-compute[73007]: INFO nova.compute.manager [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 17:57:01 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:57:01 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:57:01 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:57:01 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:57:01 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Took 0.90 seconds to deallocate network for instance.
Aug 15 17:57:01 user nova-compute[73007]: DEBUG nova.compute.manager [req-3334006b-558f-407f-924f-9f19541fc69a req-cc16953d-3125-45b7-8ee1-e9cdc07e8dbf service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received event network-vif-deleted-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:02 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Deleted allocations for instance 590854c4-c322-4f59-8026-6f1ad3c868f7
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0d341d7b-4ae4-4f2c-ada6-01192249e494 tempest-AttachVolumeNegativeTest-1698859108 tempest-AttachVolumeNegativeTest-1698859108-project-member] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:57:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Creating image(s)
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-8fd81cb3-858d-4f09-82a1-92e80a3e675b req-ff138766-1f13-4d4c-82fa-5aadc2d82913 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received event network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8fd81cb3-858d-4f09-82a1-92e80a3e675b req-ff138766-1f13-4d4c-82fa-5aadc2d82913 service nova] Acquiring lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8fd81cb3-858d-4f09-82a1-92e80a3e675b req-ff138766-1f13-4d4c-82fa-5aadc2d82913 service nova] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8fd81cb3-858d-4f09-82a1-92e80a3e675b req-ff138766-1f13-4d4c-82fa-5aadc2d82913 service nova] Lock "590854c4-c322-4f59-8026-6f1ad3c868f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-8fd81cb3-858d-4f09-82a1-92e80a3e675b req-ff138766-1f13-4d4c-82fa-5aadc2d82913 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] No waiting events found dispatching network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:57:02 user nova-compute[73007]: WARNING nova.compute.manager [req-8fd81cb3-858d-4f09-82a1-92e80a3e675b req-ff138766-1f13-4d4c-82fa-5aadc2d82913 service nova] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Received unexpected event network-vif-plugged-6eb1c835-6362-4877-b988-855367fe8ef4 for instance with vm_state deleted and task_state None.
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.223s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk 1073741824" returned: 0 in 0.049s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.177s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Cannot resize image /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Ensure instance console log exists: /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Start _get_guest_xml network_info=[{"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzbCoqJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '91cffe2e-5666-471f-a45f-1c14ea6668dd', 'attached_at': '', 'detached_at': '', 'volume_id': '4269b050-c1e1-4e6f-9bda-28e21f5e0f62', 'serial': '4269b050-c1e1-4e6f-9bda-28e21f5e0f62'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'e2a05b98-6dde-43ac-9e16-1c4e00fbcb62', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:57:03 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 17:57:03 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.objects.instance [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'vcpu_model' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzbCoqJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:57:03 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:57:03 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:57:03 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ffa435-4673-48f7-8b29-df32ea1f080d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:57:03 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faa000e-57a9-4d6e-ab8b-518c337e36d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62] added
Aug 15 17:57:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22f1205-e10a-4ea2-954c-f971e85fefcb]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[913de07e-37ee-417a-a0a1-15da446c2961]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzbCoqJy {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IzbCoqJy" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b374cf1a-79e3-4528-a0e3-f01e9d08cc4c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IzbCoqJy'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e01d5-cd53-4b0c-8e49-0a6558f6e0da]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6a9bb6-266e-4965-9f0a-c601b53b0b58]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d692be-e0f2-4afe-a0ee-cc63323671b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260]
Aug 15 17:57:03 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260] successful.
Aug 15 17:57:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[120dbe0d-daaf-4dbb-acaa-d542376aba82]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[923b0380-cfd9-476c-b11b-8a4fabf42356]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:57:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[18805fe3-e308-4c50-b4e0-57e8f933af53]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:57:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzbCoqJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23533616461376331', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533616461376331', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-740136733',display_name='tempest-ServerActionsTestOtherA-server-1710520802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-740136733',id=33,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdIs/eg2C8hauxoxVn9GAyoaiKlWml9Ipd/bLniZNf2EVQLJEHP9kIsjS/Jx6/BcyOgdQkj1N/mtGmcqCV+UW+HVYjF0SpmAzPzt3hJlQgzHSNIQFR73eqoWQSg1o/Mw==',key_name='tempest-keypair-1434873340',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-8h08cfb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:56:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=91cffe2e-5666-471f-a45f-1c14ea6668dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:57:04 user nova-compute[73007]:   <uuid>91cffe2e-5666-471f-a45f-1c14ea6668dd</uuid>
Aug 15 17:57:04 user nova-compute[73007]:   <name>instance-00000021</name>
Aug 15 17:57:04 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:57:04 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:57:04 user nova-compute[73007]:   <metadata>
Aug 15 17:57:04 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:57:04 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:57:04 user nova-compute[73007]:       <nova:name>tempest-ServerActionsTestOtherA-server-1710520802</nova:name>
Aug 15 17:57:04 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:57:03</nova:creationTime>
Aug 15 17:57:04 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:57:04 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:57:04 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:57:04 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:57:04 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:57:04 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:57:04 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:57:04 user nova-compute[73007]:       <nova:owner>
Aug 15 17:57:04 user nova-compute[73007]:         <nova:user uuid="d52391420381427297cc8c55600112b0">tempest-ServerActionsTestOtherA-226008880-project-member</nova:user>
Aug 15 17:57:04 user nova-compute[73007]:         <nova:project uuid="09ba0a5fb91043d9a46323b202cd924c">tempest-ServerActionsTestOtherA-226008880</nova:project>
Aug 15 17:57:04 user nova-compute[73007]:       </nova:owner>
Aug 15 17:57:04 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:57:04 user nova-compute[73007]:       <nova:ports>
Aug 15 17:57:04 user nova-compute[73007]:         <nova:port uuid="3b7b0e14-4976-4854-9b48-40afa4b5f430">
Aug 15 17:57:04 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 17:57:04 user nova-compute[73007]:         </nova:port>
Aug 15 17:57:04 user nova-compute[73007]:       </nova:ports>
Aug 15 17:57:04 user nova-compute[73007]:     </nova:instance>
Aug 15 17:57:04 user nova-compute[73007]:   </metadata>
Aug 15 17:57:04 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:57:04 user nova-compute[73007]:     <system>
Aug 15 17:57:04 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:57:04 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:57:04 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:57:04 user nova-compute[73007]:       <entry name="serial">91cffe2e-5666-471f-a45f-1c14ea6668dd</entry>
Aug 15 17:57:04 user nova-compute[73007]:       <entry name="uuid">91cffe2e-5666-471f-a45f-1c14ea6668dd</entry>
Aug 15 17:57:04 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:57:04 user nova-compute[73007]:     </system>
Aug 15 17:57:04 user nova-compute[73007]:   </sysinfo>
Aug 15 17:57:04 user nova-compute[73007]:   <os>
Aug 15 17:57:04 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:57:04 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:57:04 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:57:04 user nova-compute[73007]:   </os>
Aug 15 17:57:04 user nova-compute[73007]:   <features>
Aug 15 17:57:04 user nova-compute[73007]:     <acpi/>
Aug 15 17:57:04 user nova-compute[73007]:     <apic/>
Aug 15 17:57:04 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:57:04 user nova-compute[73007]:   </features>
Aug 15 17:57:04 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:57:04 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:57:04 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:57:04 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:57:04 user nova-compute[73007]:   </clock>
Aug 15 17:57:04 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:57:04 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:57:04 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:57:04 user nova-compute[73007]:   </cpu>
Aug 15 17:57:04 user nova-compute[73007]:   <devices>
Aug 15 17:57:04 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:57:04 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:57:04 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk"/>
Aug 15 17:57:04 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:57:04 user nova-compute[73007]:     </disk>
Aug 15 17:57:04 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 17:57:04 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:57:04 user nova-compute[73007]:       <source dev="/dev/sdd"/>
Aug 15 17:57:04 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 17:57:04 user nova-compute[73007]:       <serial>4269b050-c1e1-4e6f-9bda-28e21f5e0f62</serial>
Aug 15 17:57:04 user nova-compute[73007]:     </disk>
Aug 15 17:57:04 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:57:04 user nova-compute[73007]:       <mac address="fa:16:3e:52:42:06"/>
Aug 15 17:57:04 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:57:04 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:57:04 user nova-compute[73007]:       <target dev="tap3b7b0e14-49"/>
Aug 15 17:57:04 user nova-compute[73007]:     </interface>
Aug 15 17:57:04 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:57:04 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/console.log" append="off"/>
Aug 15 17:57:04 user nova-compute[73007]:     </serial>
Aug 15 17:57:04 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:57:04 user nova-compute[73007]:     <video>
Aug 15 17:57:04 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:57:04 user nova-compute[73007]:     </video>
Aug 15 17:57:04 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:57:04 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:57:04 user nova-compute[73007]:     </rng>
Aug 15 17:57:04 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:57:04 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:57:04 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:57:04 user nova-compute[73007]:     </memballoon>
Aug 15 17:57:04 user nova-compute[73007]:   </devices>
Aug 15 17:57:04 user nova-compute[73007]: </domain>
Aug 15 17:57:04 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-740136733',display_name='tempest-ServerActionsTestOtherA-server-1710520802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-740136733',id=33,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdIs/eg2C8hauxoxVn9GAyoaiKlWml9Ipd/bLniZNf2EVQLJEHP9kIsjS/Jx6/BcyOgdQkj1N/mtGmcqCV+UW+HVYjF0SpmAzPzt3hJlQgzHSNIQFR73eqoWQSg1o/Mw==',key_name='tempest-keypair-1434873340',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-8h08cfb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:56:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=91cffe2e-5666-471f-a45f-1c14ea6668dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG os_vif [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b7b0e14-49, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b7b0e14-49, col_values=(('external_ids', {'iface-id': '3b7b0e14-4976-4854-9b48-40afa4b5f430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:42:06', 'vm-uuid': '91cffe2e-5666-471f-a45f-1c14ea6668dd'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:04 user nova-compute[73007]: INFO os_vif [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49')
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:57:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No VIF found with MAC fa:16:3e:52:42:06, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:57:05 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122210.167313, 91cffe2e-5666-471f-a45f-1c14ea6668dd => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:57:05 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] VM Stopped (Lifecycle Event)
Aug 15 17:57:05 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:57:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 17:57:05 user nova-compute[73007]: DEBUG nova.compute.manager [None req-be01959a-7b53-44da-baa9-ff23ea9f38f4 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:57:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:57:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:57:05 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:57:05 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [{"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-8b23c7bd-e243-4e1d-b88a-e394e3191344" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-36769990-3ffc-43f3-b4f5-0d09a5a34113 req-9114b2e4-c94a-46a5-8699-39ea8866a82d service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36769990-3ffc-43f3-b4f5-0d09a5a34113 req-9114b2e4-c94a-46a5-8699-39ea8866a82d service nova] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36769990-3ffc-43f3-b4f5-0d09a5a34113 req-9114b2e4-c94a-46a5-8699-39ea8866a82d service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36769990-3ffc-43f3-b4f5-0d09a5a34113 req-9114b2e4-c94a-46a5-8699-39ea8866a82d service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-36769990-3ffc-43f3-b4f5-0d09a5a34113 req-9114b2e4-c94a-46a5-8699-39ea8866a82d service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] No waiting events found dispatching network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:57:06 user nova-compute[73007]: WARNING nova.compute.manager [req-36769990-3ffc-43f3-b4f5-0d09a5a34113 req-9114b2e4-c94a-46a5-8699-39ea8866a82d service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received unexpected event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 17:57:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:07 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-1baff526-ef70-4768-9e68-258ce84d8ff9 req-8c5a6bb7-78b9-4207-917c-7ef01f67a959 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1baff526-ef70-4768-9e68-258ce84d8ff9 req-8c5a6bb7-78b9-4207-917c-7ef01f67a959 service nova] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1baff526-ef70-4768-9e68-258ce84d8ff9 req-8c5a6bb7-78b9-4207-917c-7ef01f67a959 service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1baff526-ef70-4768-9e68-258ce84d8ff9 req-8c5a6bb7-78b9-4207-917c-7ef01f67a959 service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-1baff526-ef70-4768-9e68-258ce84d8ff9 req-8c5a6bb7-78b9-4207-917c-7ef01f67a959 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] No waiting events found dispatching network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:57:08 user nova-compute[73007]: WARNING nova.compute.manager [req-1baff526-ef70-4768-9e68-258ce84d8ff9 req-8c5a6bb7-78b9-4207-917c-7ef01f67a959 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received unexpected event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122228.5662313, 91cffe2e-5666-471f-a45f-1c14ea6668dd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:57:08 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] VM Resumed (Lifecycle Event)
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:57:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance spawned successfully.
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:57:08 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122228.567369, 91cffe2e-5666-471f-a45f-1c14ea6668dd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:57:08 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] VM Started (Lifecycle Event)
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:57:08 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG nova.objects.instance [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73007) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 17:57:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-664ffe2e-01de-4a4e-bdc9-201b247bba90 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.086s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:11 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122218.221794, 64379e41-9e78-4389-aee2-14388d2366d5 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:57:13 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] VM Stopped (Lifecycle Event)
Aug 15 17:57:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a281d494-cad7-4516-a24b-98b16a50c76e None None] [instance: 64379e41-9e78-4389-aee2-14388d2366d5] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:57:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122220.9409726, 590854c4-c322-4f59-8026-6f1ad3c868f7 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:57:16 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] VM Stopped (Lifecycle Event)
Aug 15 17:57:16 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:57:16 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7230MB free_disk=25.28708267211914GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-efbcdd9a-d328-4af4-b7ab-4f171f50011e None None] [instance: 590854c4-c322-4f59-8026-6f1ad3c868f7] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 8b23c7bd-e243-4e1d-b88a-e394e3191344 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 28635f62-bb70-454f-ab7a-c40e48ba2950 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 91cffe2e-5666-471f-a45f-1c14ea6668dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 029c5519-9937-439c-9fc7-f1bad76d26f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 94d41039-6dd8-4e12-aea8-b57f4837f4fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:57:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:17 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:17 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:17 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:57:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:57:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:39 user nova-compute[73007]: INFO nova.compute.manager [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Terminating instance
Aug 15 17:57:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-f421bbf6-7ea9-42a4-bbe0-59e35aad6d7b req-78fa5e65-08f9-44a6-8463-572133a9f933 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f421bbf6-7ea9-42a4-bbe0-59e35aad6d7b req-78fa5e65-08f9-44a6-8463-572133a9f933 service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f421bbf6-7ea9-42a4-bbe0-59e35aad6d7b req-78fa5e65-08f9-44a6-8463-572133a9f933 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f421bbf6-7ea9-42a4-bbe0-59e35aad6d7b req-78fa5e65-08f9-44a6-8463-572133a9f933 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-f421bbf6-7ea9-42a4-bbe0-59e35aad6d7b req-78fa5e65-08f9-44a6-8463-572133a9f933 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-f421bbf6-7ea9-42a4-bbe0-59e35aad6d7b req-78fa5e65-08f9-44a6-8463-572133a9f933 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-unplugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:40 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Instance destroyed successfully.
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lazy-loading 'resources' on Instance uuid 8b23c7bd-e243-4e1d-b88a-e394e3191344 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:48:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1486128635',display_name='tempest-ServerActionsTestOtherB-server-1486128635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1486128635',id=17,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwLGM9cPpFlMLgcwKLcN0LA4UoJ7Mjd/qOyJdHyN4XOw0ilKPJ+3LBqyCmyyR3GTGA5R0cqA0d0T38uOXedCLQPAwlgoz2/sNUzHqzW/b9XisvQ50gkjGRkeJd6f9clYw==',key_name='tempest-keypair-1520634187',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:55:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d1bc8ca5f444b73ae2ccf1c29c9dee3',ramdisk_id='',reservation_id='r-gqfc57i1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-604941371',owner_user_name='tempest-ServerActionsTestOtherB-604941371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c04d1f1310ec43aa9b4f500267105f1d',uuid=8b23c7bd-e243-4e1d-b88a-e394e3191344,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converting VIF {"id": "89f9df72-5653-4107-9de4-9919b16b7f17", "address": "fa:16:3e:95:7c:d9", "network": {"id": "004d46a9-3253-448d-9e26-c9aba0c32822", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1361397922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d1bc8ca5f444b73ae2ccf1c29c9dee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f9df72-56", "ovs_interfaceid": "89f9df72-5653-4107-9de4-9919b16b7f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_vif [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89f9df72-56, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:40 user nova-compute[73007]: INFO os_vif [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7c:d9,bridge_name='br-int',has_traffic_filtering=True,id=89f9df72-5653-4107-9de4-9919b16b7f17,network=Network(004d46a9-3253-448d-9e26-c9aba0c32822),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f9df72-56')
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ElhGBiqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:57:40 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[76509720-33f2-41e1-bce5-2be4ce66444d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a23192c-ddc8-4b8f-a631-d02e5f07aac8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:57:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c4096c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7'): ({'sdf'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Removing single pathed devices sdf {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce3dbf-09dd-4e5e-9331-c70876d110a8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2925739-4750-4b99-aa4f-eb5046c859e0]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Flushing IO for device /dev/sdf {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f00fbc9-f4cb-4056-8cd0-c4d085dac582]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c9aa9-af4d-47f7-a483-fd7cf04abc49]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2eba47-2277-4ee1-a85c-bd9d1aaff78b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[013a927b-ac29-4e9f-8f5b-8d625f9c4f06]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260]
Aug 15 17:57:40 user nova-compute[73007]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7, portal: 172.16.0.220,3260] successful.
Aug 15 17:57:40 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f4a21dd-e2fe-4302-beb7-ec9a094317f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdfe586-8fc3-45ec-9508-e9a493d772ec]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] <== disconnect_volume: return (350ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:57:40 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:57:40 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Deleting instance files /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344_del
Aug 15 17:57:40 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Deletion of /opt/stack/data/nova/instances/8b23c7bd-e243-4e1d-b88a-e394e3191344_del complete
Aug 15 17:57:41 user nova-compute[73007]: INFO nova.compute.manager [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 15 17:57:41 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:57:41 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:57:41 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:57:42 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:57:42 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Took 1.10 seconds to deallocate network for instance.
Aug 15 17:57:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-37bc2d3d-b8a8-473d-ad7e-2b6de10e8e0c req-f688f6d1-6519-4bc2-88f0-669a6bc17420 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-deleted-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-b09290cc-f533-4a39-8938-2a5d6e7eb922 req-c3d1ec76-9e27-49f7-8ade-8a6c6dd7a1b1 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b09290cc-f533-4a39-8938-2a5d6e7eb922 req-c3d1ec76-9e27-49f7-8ade-8a6c6dd7a1b1 service nova] Acquiring lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b09290cc-f533-4a39-8938-2a5d6e7eb922 req-c3d1ec76-9e27-49f7-8ade-8a6c6dd7a1b1 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b09290cc-f533-4a39-8938-2a5d6e7eb922 req-c3d1ec76-9e27-49f7-8ade-8a6c6dd7a1b1 service nova] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-b09290cc-f533-4a39-8938-2a5d6e7eb922 req-c3d1ec76-9e27-49f7-8ade-8a6c6dd7a1b1 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] No waiting events found dispatching network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:57:42 user nova-compute[73007]: WARNING nova.compute.manager [req-b09290cc-f533-4a39-8938-2a5d6e7eb922 req-c3d1ec76-9e27-49f7-8ade-8a6c6dd7a1b1 service nova] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Received unexpected event network-vif-plugged-89f9df72-5653-4107-9de4-9919b16b7f17 for instance with vm_state active and task_state deleting.
Aug 15 17:57:43 user nova-compute[73007]: INFO nova.compute.manager [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Took 0.89 seconds to detach 1 volumes for instance.
Aug 15 17:57:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:43 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:57:43 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:57:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:43 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Deleted allocations for instance 8b23c7bd-e243-4e1d-b88a-e394e3191344
Aug 15 17:57:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3163d261-f4c0-40a0-bd9a-9a4a7d9fa32f tempest-ServerActionsTestOtherB-604941371 tempest-ServerActionsTestOtherB-604941371-project-member] Lock "8b23c7bd-e243-4e1d-b88a-e394e3191344" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.822s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-92b8be2b-1397-44a7-b60d-a75e1a1ea3a5 req-fe30a090-9179-4f03-af91-0d29a9ca9ea3 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received event network-changed-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:57:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-92b8be2b-1397-44a7-b60d-a75e1a1ea3a5 req-fe30a090-9179-4f03-af91-0d29a9ca9ea3 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Refreshing instance network info cache due to event network-changed-0d174333-6d24-437d-9d7a-83276d86714d. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:57:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-92b8be2b-1397-44a7-b60d-a75e1a1ea3a5 req-fe30a090-9179-4f03-af91-0d29a9ca9ea3 service nova] Acquiring lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:57:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-92b8be2b-1397-44a7-b60d-a75e1a1ea3a5 req-fe30a090-9179-4f03-af91-0d29a9ca9ea3 service nova] Acquired lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:57:54 user nova-compute[73007]: DEBUG nova.network.neutron [req-92b8be2b-1397-44a7-b60d-a75e1a1ea3a5 req-fe30a090-9179-4f03-af91-0d29a9ca9ea3 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Refreshing network info cache for port 0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:57:55 user nova-compute[73007]: DEBUG nova.network.neutron [req-92b8be2b-1397-44a7-b60d-a75e1a1ea3a5 req-fe30a090-9179-4f03-af91-0d29a9ca9ea3 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updated VIF entry in instance network info cache for port 0d174333-6d24-437d-9d7a-83276d86714d. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:57:55 user nova-compute[73007]: DEBUG nova.network.neutron [req-92b8be2b-1397-44a7-b60d-a75e1a1ea3a5 req-fe30a090-9179-4f03-af91-0d29a9ca9ea3 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating instance_info_cache with network_info: [{"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:57:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-92b8be2b-1397-44a7-b60d-a75e1a1ea3a5 req-fe30a090-9179-4f03-af91-0d29a9ca9ea3 service nova] Releasing lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:57:55 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122260.5685394, 8b23c7bd-e243-4e1d-b88a-e394e3191344 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:57:55 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] VM Stopped (Lifecycle Event)
Aug 15 17:57:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8552a125-bf6f-45fd-b11d-266af81b23c7 None None] [instance: 8b23c7bd-e243-4e1d-b88a-e394e3191344] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:57:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG nova.objects.instance [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:57:59 user nova-compute[73007]: INFO nova.compute.manager [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attaching volume a083cf2e-6c3f-475a-a379-bdfeadd6a034 to /dev/vdb
Aug 15 17:57:59 user nova-compute[73007]: DEBUG os_brick.utils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05dbec3-5ad5-4800-b447-081ff2371b02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea0fad3-b6ba-4db1-8454-b5f76d7ec941]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e813691b-52ee-4971-acb4-e699e717d5c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b28564-0396-4381-be6d-cc6209eb2f13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:57:59 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:57:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a56486-6a8d-47be-b5dc-89e2b9226e97]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG os_brick.utils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:57:59 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating existing volume attachment record: 241adb5b-b1f6-449a-9b23-e89501d186d4 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:58:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updating instance_info_cache with network_info: [{"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:58:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 17:58:08 user nova-compute[73007]: INFO nova.compute.claims [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Claim successful on node user
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 17:58:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.policy [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b7b5264253d44e9a51d06f66bed1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e88231a35bb4a2e8b5e1e7d5e5f9418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 17:58:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Creating image(s)
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "/opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "/opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "/opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.296s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk 1073741824" returned: 0 in 0.066s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Successfully created port: 55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.279s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 17:58:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Cannot resize image /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'migration_context' on Instance uuid bec479f1-341e-4879-8280-8f3bc9b9e5a0 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Ensure instance console log exists: /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAQequwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:58:10 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:58:10 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:58:10 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:58:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fb3ed3-cf39-4001-ac66-890096dbc9d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:58:10 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e87d5a7-e46c-4f22-875e-27e54f060076]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034] added
Aug 15 17:58:10 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b0e328-5ff1-47bd-80da-41a82e9aedad]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0acffc6-4af6-4dab-9fec-4fbf7683d7a4]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAQequwy {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KAQequwy" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e247b9-504c-40ee-b7e0-d565a2bfe779]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KAQequwy'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[70094d69-fe2b-4ea9-b52a-b516ccc2f102]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f4dba8-ce5e-478d-96c3-39429aa0001e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:58:10 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:58:10 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:58:10 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:58:10 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:58:10 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:58:10 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:58:10 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:58:10 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67156a-dea3-4166-bc98-1c3983ad2a83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034, portal: 172.16.0.220,3260]
Aug 15 17:58:10 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034, portal: 172.16.0.220,3260] successful.
Aug 15 17:58:10 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[103abbb2-6e8d-4998-9fd0-628cb97b7491]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fbae01-e140-4140-b739-f2a95aa2e627]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)
Aug 15 17:58:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Successfully updated port: 55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "refresh_cache-bec479f1-341e-4879-8280-8f3bc9b9e5a0" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquired lock "refresh_cache-bec479f1-341e-4879-8280-8f3bc9b9e5a0" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65835b82-7d1f-4997-b03c-0a220ee15cc4]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAQequwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-51bbe384-9749-40e9-8a31-1d491eb06c48 req-4b677c02-694b-495b-9ace-10f6267ad8bf service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received event network-changed-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-51bbe384-9749-40e9-8a31-1d491eb06c48 req-4b677c02-694b-495b-9ace-10f6267ad8bf service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Refreshing instance network info cache due to event network-changed-55b461e7-4199-4856-a1b0-d2bb302db323. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51bbe384-9749-40e9-8a31-1d491eb06c48 req-4b677c02-694b-495b-9ace-10f6267ad8bf service nova] Acquiring lock "refresh_cache-bec479f1-341e-4879-8280-8f3bc9b9e5a0" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Updating instance_info_cache with network_info: [{"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Releasing lock "refresh_cache-bec479f1-341e-4879-8280-8f3bc9b9e5a0" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Instance network_info: |[{"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51bbe384-9749-40e9-8a31-1d491eb06c48 req-4b677c02-694b-495b-9ace-10f6267ad8bf service nova] Acquired lock "refresh_cache-bec479f1-341e-4879-8280-8f3bc9b9e5a0" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-51bbe384-9749-40e9-8a31-1d491eb06c48 req-4b677c02-694b-495b-9ace-10f6267ad8bf service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Refreshing network info cache for port 55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Start _get_guest_xml network_info=[{"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 17:58:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:58:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2023879861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2023879861',id=36,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-4kr7qazz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:58:09Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=bec479f1-341e-4879-8280-8f3bc9b9e5a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=55b461e7-4199-4856-a1b0-d2bb302db323,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b461e7-41') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'pci_devices' on Instance uuid bec479f1-341e-4879-8280-8f3bc9b9e5a0 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 17:58:11 user nova-compute[73007]:   <uuid>bec479f1-341e-4879-8280-8f3bc9b9e5a0</uuid>
Aug 15 17:58:11 user nova-compute[73007]:   <name>instance-00000024</name>
Aug 15 17:58:11 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 17:58:11 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 17:58:11 user nova-compute[73007]:   <metadata>
Aug 15 17:58:11 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 17:58:11 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 17:58:11 user nova-compute[73007]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2023879861</nova:name>
Aug 15 17:58:11 user nova-compute[73007]:       <nova:creationTime>2023-08-15 17:58:11</nova:creationTime>
Aug 15 17:58:11 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 17:58:11 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 17:58:11 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 17:58:11 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 17:58:11 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 17:58:11 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 17:58:11 user nova-compute[73007]:       </nova:flavor>
Aug 15 17:58:11 user nova-compute[73007]:       <nova:owner>
Aug 15 17:58:11 user nova-compute[73007]:         <nova:user uuid="2b7b5264253d44e9a51d06f66bed1443">tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member</nova:user>
Aug 15 17:58:11 user nova-compute[73007]:         <nova:project uuid="6e88231a35bb4a2e8b5e1e7d5e5f9418">tempest-ServerBootFromVolumeStableRescueTest-452961283</nova:project>
Aug 15 17:58:11 user nova-compute[73007]:       </nova:owner>
Aug 15 17:58:11 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 17:58:11 user nova-compute[73007]:       <nova:ports>
Aug 15 17:58:11 user nova-compute[73007]:         <nova:port uuid="55b461e7-4199-4856-a1b0-d2bb302db323">
Aug 15 17:58:11 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 17:58:11 user nova-compute[73007]:         </nova:port>
Aug 15 17:58:11 user nova-compute[73007]:       </nova:ports>
Aug 15 17:58:11 user nova-compute[73007]:     </nova:instance>
Aug 15 17:58:11 user nova-compute[73007]:   </metadata>
Aug 15 17:58:11 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 17:58:11 user nova-compute[73007]:     <system>
Aug 15 17:58:11 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 17:58:11 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 17:58:11 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 17:58:11 user nova-compute[73007]:       <entry name="serial">bec479f1-341e-4879-8280-8f3bc9b9e5a0</entry>
Aug 15 17:58:11 user nova-compute[73007]:       <entry name="uuid">bec479f1-341e-4879-8280-8f3bc9b9e5a0</entry>
Aug 15 17:58:11 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 17:58:11 user nova-compute[73007]:     </system>
Aug 15 17:58:11 user nova-compute[73007]:   </sysinfo>
Aug 15 17:58:11 user nova-compute[73007]:   <os>
Aug 15 17:58:11 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 17:58:11 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 17:58:11 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 17:58:11 user nova-compute[73007]:   </os>
Aug 15 17:58:11 user nova-compute[73007]:   <features>
Aug 15 17:58:11 user nova-compute[73007]:     <acpi/>
Aug 15 17:58:11 user nova-compute[73007]:     <apic/>
Aug 15 17:58:11 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 17:58:11 user nova-compute[73007]:   </features>
Aug 15 17:58:11 user nova-compute[73007]:   <clock offset="utc">
Aug 15 17:58:11 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 17:58:11 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 17:58:11 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 17:58:11 user nova-compute[73007]:   </clock>
Aug 15 17:58:11 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 17:58:11 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 17:58:11 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 17:58:11 user nova-compute[73007]:   </cpu>
Aug 15 17:58:11 user nova-compute[73007]:   <devices>
Aug 15 17:58:11 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 17:58:11 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 17:58:11 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk"/>
Aug 15 17:58:11 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 17:58:11 user nova-compute[73007]:     </disk>
Aug 15 17:58:11 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 17:58:11 user nova-compute[73007]:       <mac address="fa:16:3e:73:11:7e"/>
Aug 15 17:58:11 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:58:11 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 17:58:11 user nova-compute[73007]:       <target dev="tap55b461e7-41"/>
Aug 15 17:58:11 user nova-compute[73007]:     </interface>
Aug 15 17:58:11 user nova-compute[73007]:     <serial type="pty">
Aug 15 17:58:11 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/console.log" append="off"/>
Aug 15 17:58:11 user nova-compute[73007]:     </serial>
Aug 15 17:58:11 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 17:58:11 user nova-compute[73007]:     <video>
Aug 15 17:58:11 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 17:58:11 user nova-compute[73007]:     </video>
Aug 15 17:58:11 user nova-compute[73007]:     <rng model="virtio">
Aug 15 17:58:11 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 17:58:11 user nova-compute[73007]:     </rng>
Aug 15 17:58:11 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 17:58:11 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 17:58:11 user nova-compute[73007]:       <stats period="10"/>
Aug 15 17:58:11 user nova-compute[73007]:     </memballoon>
Aug 15 17:58:11 user nova-compute[73007]:   </devices>
Aug 15 17:58:11 user nova-compute[73007]: </domain>
Aug 15 17:58:11 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2023879861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2023879861',id=36,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-4kr7qazz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T17:58:09Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=bec479f1-341e-4879-8280-8f3bc9b9e5a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=55b461e7-4199-4856-a1b0-d2bb302db323,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b461e7-41') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG os_vif [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=55b461e7-4199-4856-a1b0-d2bb302db323,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b461e7-41') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55b461e7-41, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55b461e7-41, col_values=(('external_ids', {'iface-id': '55b461e7-4199-4856-a1b0-d2bb302db323', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:11:7e', 'vm-uuid': 'bec479f1-341e-4879-8280-8f3bc9b9e5a0'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:11 user nova-compute[73007]: INFO os_vif [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=55b461e7-4199-4856-a1b0-d2bb302db323,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b461e7-41')
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:58:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No VIF found with MAC fa:16:3e:73:11:7e, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '26432343539303463', 'path': '/dev/sdf'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432343539303463', 'path': '/dev/sdf'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:58:12 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:58:12 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 17:58:12 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:58:12 user nova-compute[73007]:   <serial>a083cf2e-6c3f-475a-a379-bdfeadd6a034</serial>
Aug 15 17:58:12 user nova-compute[73007]: </disk>
Aug 15 17:58:12 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-51bbe384-9749-40e9-8a31-1d491eb06c48 req-4b677c02-694b-495b-9ace-10f6267ad8bf service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Updated VIF entry in instance network info cache for port 55b461e7-4199-4856-a1b0-d2bb302db323. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-51bbe384-9749-40e9-8a31-1d491eb06c48 req-4b677c02-694b-495b-9ace-10f6267ad8bf service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Updating instance_info_cache with network_info: [{"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-51bbe384-9749-40e9-8a31-1d491eb06c48 req-4b677c02-694b-495b-9ace-10f6267ad8bf service nova] Releasing lock "refresh_cache-bec479f1-341e-4879-8280-8f3bc9b9e5a0" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:58:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No VIF found with MAC fa:16:3e:6b:92:1b, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5d1e3615-dadc-4f1c-b244-81ade2f08276 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.575s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-eee68a66-4253-4495-a9d5-e085e266fc3b req-ed94686c-a5fe-4703-984a-d8677f5737af service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received event network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-eee68a66-4253-4495-a9d5-e085e266fc3b req-ed94686c-a5fe-4703-984a-d8677f5737af service nova] Acquiring lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-eee68a66-4253-4495-a9d5-e085e266fc3b req-ed94686c-a5fe-4703-984a-d8677f5737af service nova] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-eee68a66-4253-4495-a9d5-e085e266fc3b req-ed94686c-a5fe-4703-984a-d8677f5737af service nova] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-eee68a66-4253-4495-a9d5-e085e266fc3b req-ed94686c-a5fe-4703-984a-d8677f5737af service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] No waiting events found dispatching network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:58:14 user nova-compute[73007]: WARNING nova.compute.manager [req-eee68a66-4253-4495-a9d5-e085e266fc3b req-ed94686c-a5fe-4703-984a-d8677f5737af service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received unexpected event network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 for instance with vm_state building and task_state spawning.
Aug 15 17:58:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122296.1569042, bec479f1-341e-4879-8280-8f3bc9b9e5a0 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:58:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] VM Resumed (Lifecycle Event)
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-d5164ab8-6248-426f-99a0-9225f18b88bf req-d92628e9-4365-4433-b251-e6031e8e96ed service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received event network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d5164ab8-6248-426f-99a0-9225f18b88bf req-d92628e9-4365-4433-b251-e6031e8e96ed service nova] Acquiring lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d5164ab8-6248-426f-99a0-9225f18b88bf req-d92628e9-4365-4433-b251-e6031e8e96ed service nova] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d5164ab8-6248-426f-99a0-9225f18b88bf req-d92628e9-4365-4433-b251-e6031e8e96ed service nova] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-d5164ab8-6248-426f-99a0-9225f18b88bf req-d92628e9-4365-4433-b251-e6031e8e96ed service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] No waiting events found dispatching network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:58:16 user nova-compute[73007]: WARNING nova.compute.manager [req-d5164ab8-6248-426f-99a0-9225f18b88bf req-d92628e9-4365-4433-b251-e6031e8e96ed service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received unexpected event network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 for instance with vm_state building and task_state spawning.
Aug 15 17:58:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Instance spawned successfully.
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 17:58:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122296.15816, bec479f1-341e-4879-8280-8f3bc9b9e5a0 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:58:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] VM Started (Lifecycle Event)
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:58:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 17:58:16 user nova-compute[73007]: INFO nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Took 7.50 seconds to spawn the instance on the hypervisor.
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:16 user nova-compute[73007]: INFO nova.compute.manager [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Took 8.62 seconds to build instance.
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b89402df-bab0-40ab-8dd1-a34d1fa71374 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.776s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-43dc9531-d78f-454a-801e-aa92780d4d98 req-519b8f94-a633-46f0-bad9-b077b970433d service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received event network-changed-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-43dc9531-d78f-454a-801e-aa92780d4d98 req-519b8f94-a633-46f0-bad9-b077b970433d service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Refreshing instance network info cache due to event network-changed-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-43dc9531-d78f-454a-801e-aa92780d4d98 req-519b8f94-a633-46f0-bad9-b077b970433d service nova] Acquiring lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-43dc9531-d78f-454a-801e-aa92780d4d98 req-519b8f94-a633-46f0-bad9-b077b970433d service nova] Acquired lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG nova.network.neutron [req-43dc9531-d78f-454a-801e-aa92780d4d98 req-519b8f94-a633-46f0-bad9-b077b970433d service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Refreshing network info cache for port e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG nova.network.neutron [req-43dc9531-d78f-454a-801e-aa92780d4d98 req-519b8f94-a633-46f0-bad9-b077b970433d service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Updated VIF entry in instance network info cache for port e7f6b3eb-3814-4c7a-93f6-f69e41ee649d. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG nova.network.neutron [req-43dc9531-d78f-454a-801e-aa92780d4d98 req-519b8f94-a633-46f0-bad9-b077b970433d service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Updating instance_info_cache with network_info: [{"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-43dc9531-d78f-454a-801e-aa92780d4d98 req-519b8f94-a633-46f0-bad9-b077b970433d service nova] Releasing lock "refresh_cache-94d41039-6dd8-4e12-aea8-b57f4837f4fa" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:18 user nova-compute[73007]: INFO nova.compute.manager [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Terminating instance
Aug 15 17:58:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-6dca7815-d77c-446a-8c2f-7824299fa34f req-682be5e2-02e8-400d-a997-5a7b3ca2dd72 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received event network-vif-unplugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dca7815-d77c-446a-8c2f-7824299fa34f req-682be5e2-02e8-400d-a997-5a7b3ca2dd72 service nova] Acquiring lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dca7815-d77c-446a-8c2f-7824299fa34f req-682be5e2-02e8-400d-a997-5a7b3ca2dd72 service nova] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dca7815-d77c-446a-8c2f-7824299fa34f req-682be5e2-02e8-400d-a997-5a7b3ca2dd72 service nova] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-6dca7815-d77c-446a-8c2f-7824299fa34f req-682be5e2-02e8-400d-a997-5a7b3ca2dd72 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] No waiting events found dispatching network-vif-unplugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-6dca7815-d77c-446a-8c2f-7824299fa34f req-682be5e2-02e8-400d-a997-5a7b3ca2dd72 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received event network-vif-unplugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:58:20 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:58:20 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7447MB free_disk=25.272232055664062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Instance destroyed successfully.
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'resources' on Instance uuid 94d41039-6dd8-4e12-aea8-b57f4837f4fa {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:56:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-515683340',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-515683340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-515683340',id=35,image_ref='3ef8bceb-20aa-49e4-abd8-ce5ca7fd49d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuWSLE3w9G16InICYteiRWznDTWKa2E3FqnTfsEO/3N9DdbjbJJ4ulsqZw6aLkiA/GIkZBEm0J9hUskZ1/N4snwQPqx74hGDF0LDIHdK5klOd2+G6Dq1a2xRsxD0wV9tA==',key_name='tempest-keypair-777160582',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:56:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-078xmep0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-393609756',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=94d41039-6dd8-4e12-aea8-b57f4837f4fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "address": "fa:16:3e:6c:66:7e", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7f6b3eb-38", "ovs_interfaceid": "e7f6b3eb-3814-4c7a-93f6-f69e41ee649d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:66:7e,bridge_name='br-int',has_traffic_filtering=True,id=e7f6b3eb-3814-4c7a-93f6-f69e41ee649d,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f6b3eb-38') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_vif [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:66:7e,bridge_name='br-int',has_traffic_filtering=True,id=e7f6b3eb-3814-4c7a-93f6-f69e41ee649d,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f6b3eb-38') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7f6b3eb-38, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:20 user nova-compute[73007]: INFO os_vif [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:66:7e,bridge_name='br-int',has_traffic_filtering=True,id=e7f6b3eb-3814-4c7a-93f6-f69e41ee649d,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7f6b3eb-38')
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naXGYQcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:58:20 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.044s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f7ed9f-1900-46ef-9bfb-a3d25a1eec54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6efa6b-38f2-4f0c-b057-ea0ccaad2b3f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)
Aug 15 17:58:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c5ec3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2f89d-f12f-4842-af65-7d3347b61d7f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 28635f62-bb70-454f-ab7a-c40e48ba2950 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 91cffe2e-5666-471f-a45f-1c14ea6668dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 029c5519-9937-439c-9fc7-f1bad76d26f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 94d41039-6dd8-4e12-aea8-b57f4837f4fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f3be95-4327-404f-a2b4-9fef8de27d4c]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[617da9b1-3257-4702-874d-91280a7fd08d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac7833b-b8a0-4b2f-bdf0-7f066028f87f]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1c6f08-8a5c-4f2f-a411-a348358c3ad8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c04b83-be7c-48b5-a751-8584ed0578d4]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065, portal: 172.16.0.220,3260]
Aug 15 17:58:20 user nova-compute[73007]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065, portal: 172.16.0.220,3260] successful.
Aug 15 17:58:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6170d2bf-1c30-4c04-b550-23ec51880065 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2d1952-a683-49cf-98ae-21738822a5d3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.476s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== disconnect_volume: return (477ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:58:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Deleting instance files /opt/stack/data/nova/instances/94d41039-6dd8-4e12-aea8-b57f4837f4fa_del
Aug 15 17:58:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Deletion of /opt/stack/data/nova/instances/94d41039-6dd8-4e12-aea8-b57f4837f4fa_del complete
Aug 15 17:58:20 user nova-compute[73007]: INFO nova.compute.manager [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Took 2.17 seconds to destroy the instance on the hypervisor.
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:58:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.850s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-e617c0fd-4bc7-4d42-bfe8-0924655eb2f1 req-bd638fbf-ee1e-4421-8ab4-7fab9d1e85b0 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received event network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e617c0fd-4bc7-4d42-bfe8-0924655eb2f1 req-bd638fbf-ee1e-4421-8ab4-7fab9d1e85b0 service nova] Acquiring lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e617c0fd-4bc7-4d42-bfe8-0924655eb2f1 req-bd638fbf-ee1e-4421-8ab4-7fab9d1e85b0 service nova] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e617c0fd-4bc7-4d42-bfe8-0924655eb2f1 req-bd638fbf-ee1e-4421-8ab4-7fab9d1e85b0 service nova] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:21 user nova-compute[73007]: DEBUG nova.compute.manager [req-e617c0fd-4bc7-4d42-bfe8-0924655eb2f1 req-bd638fbf-ee1e-4421-8ab4-7fab9d1e85b0 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] No waiting events found dispatching network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:58:21 user nova-compute[73007]: WARNING nova.compute.manager [req-e617c0fd-4bc7-4d42-bfe8-0924655eb2f1 req-bd638fbf-ee1e-4421-8ab4-7fab9d1e85b0 service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received unexpected event network-vif-plugged-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d for instance with vm_state active and task_state deleting.
Aug 15 17:58:22 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:58:22 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Took 1.75 seconds to deallocate network for instance.
Aug 15 17:58:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-2a5e9d4d-3881-42cf-bc79-9309a92a54ff req-e348f01a-b69a-4dac-bf29-c52ffdba7b3a service nova] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Received event network-vif-deleted-e7f6b3eb-3814-4c7a-93f6-f69e41ee649d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:58:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:58:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:26 user nova-compute[73007]: INFO nova.compute.manager [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Took 4.04 seconds to detach 1 volumes for instance.
Aug 15 17:58:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Deleting volume: 6170d2bf-1c30-4c04-b550-23ec51880065 {{(pid=73007) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 17:58:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:27 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:58:27 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:58:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:27 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Deleted allocations for instance 94d41039-6dd8-4e12-aea8-b57f4837f4fa
Aug 15 17:58:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b2f5c31a-9821-41c7-b105-e660de36d586 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "94d41039-6dd8-4e12-aea8-b57f4837f4fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.755s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:32 user nova-compute[73007]: INFO nova.compute.manager [None req-e0300f9d-434c-44bb-9028-e1166aed4687 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Unrescuing
Aug 15 17:58:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e0300f9d-434c-44bb-9028-e1166aed4687 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:58:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e0300f9d-434c-44bb-9028-e1166aed4687 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquired lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:58:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-e0300f9d-434c-44bb-9028-e1166aed4687 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-e0300f9d-434c-44bb-9028-e1166aed4687 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updating instance_info_cache with network_info: [{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e0300f9d-434c-44bb-9028-e1166aed4687 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Releasing lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG nova.objects.instance [None req-e0300f9d-434c-44bb-9028-e1166aed4687 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'flavor' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-08f05ad3-9f04-48e6-bbac-8674a618bbe7 req-9e353b12-1632-4705-aa1e-420ce89beb2f service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08f05ad3-9f04-48e6-bbac-8674a618bbe7 req-9e353b12-1632-4705-aa1e-420ce89beb2f service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08f05ad3-9f04-48e6-bbac-8674a618bbe7 req-9e353b12-1632-4705-aa1e-420ce89beb2f service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-08f05ad3-9f04-48e6-bbac-8674a618bbe7 req-9e353b12-1632-4705-aa1e-420ce89beb2f service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-08f05ad3-9f04-48e6-bbac-8674a618bbe7 req-9e353b12-1632-4705-aa1e-420ce89beb2f service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:58:34 user nova-compute[73007]: WARNING nova.compute.manager [req-08f05ad3-9f04-48e6-bbac-8674a618bbe7 req-9e353b12-1632-4705-aa1e-420ce89beb2f service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:58:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:35 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122299.34688, 94d41039-6dd8-4e12-aea8-b57f4837f4fa => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:58:35 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] VM Stopped (Lifecycle Event)
Aug 15 17:58:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-686145c2-1498-46d4-acde-4fbc6ee5c158 None None] [instance: 94d41039-6dd8-4e12-aea8-b57f4837f4fa] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:58:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance destroyed successfully.
Aug 15 17:58:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-6c29c3a2-c1e3-4dd2-86a5-e36fd4282977 req-10929431-fec0-469a-a1d6-f377633f5d1f service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6c29c3a2-c1e3-4dd2-86a5-e36fd4282977 req-10929431-fec0-469a-a1d6-f377633f5d1f service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6c29c3a2-c1e3-4dd2-86a5-e36fd4282977 req-10929431-fec0-469a-a1d6-f377633f5d1f service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6c29c3a2-c1e3-4dd2-86a5-e36fd4282977 req-10929431-fec0-469a-a1d6-f377633f5d1f service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-6c29c3a2-c1e3-4dd2-86a5-e36fd4282977 req-10929431-fec0-469a-a1d6-f377633f5d1f service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:58:36 user nova-compute[73007]: WARNING nova.compute.manager [req-6c29c3a2-c1e3-4dd2-86a5-e36fd4282977 req-10929431-fec0-469a-a1d6-f377633f5d1f service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:58:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:58:38 user nova-compute[73007]: WARNING nova.compute.manager [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:58:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:58:38 user nova-compute[73007]: WARNING nova.compute.manager [req-4a81bf54-e876-4b96-a077-5cb28ddc7b4e req-88947b09-d419-424a-aa3b-07a3f1229498 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state rescued and task_state unrescuing.
Aug 15 17:58:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for b8628c95-e352-41e4-b7d5-af0aa9ebcb0c due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 17:58:39 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122319.2579763, b8628c95-e352-41e4-b7d5-af0aa9ebcb0c => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:58:39 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] VM Resumed (Lifecycle Event)
Aug 15 17:58:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-e0300f9d-434c-44bb-9028-e1166aed4687 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:58:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:58:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:58:39 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 17:58:39 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122319.2620516, b8628c95-e352-41e4-b7d5-af0aa9ebcb0c => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:58:39 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] VM Started (Lifecycle Event)
Aug 15 17:58:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:58:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 17:58:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:58:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:58:45 user nova-compute[73007]: INFO nova.compute.manager [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Detaching volume a083cf2e-6c3f-475a-a379-bdfeadd6a034
Aug 15 17:58:45 user nova-compute[73007]: INFO nova.virt.block_device [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attempting to driver detach volume a083cf2e-6c3f-475a-a379-bdfeadd6a034 from mountpoint /dev/vdb
Aug 15 17:58:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Attempting to detach device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:58:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:58:45 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:58:45 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 17:58:45 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:58:45 user nova-compute[73007]:   <serial>a083cf2e-6c3f-475a-a379-bdfeadd6a034</serial>
Aug 15 17:58:45 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:58:45 user nova-compute[73007]: </disk>
Aug 15 17:58:45 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:58:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully detached device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the persistent domain config.
Aug 15 17:58:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:58:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:58:45 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:58:45 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 17:58:45 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:58:45 user nova-compute[73007]:   <serial>a083cf2e-6c3f-475a-a379-bdfeadd6a034</serial>
Aug 15 17:58:45 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:58:45 user nova-compute[73007]: </disk>
Aug 15 17:58:45 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122326.1292725, 029c5519-9937-439c-9fc7-f1bad76d26f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:58:46 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully detached device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the live domain config.
Aug 15 17:58:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KAQequwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:58:46 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5023558-9fbe-4f66-b2da-3f7bd2ed4b03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab53f92a-91a6-4faa-be41-6e985f9960cd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:58:46 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:58:46 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:58:46 user nova-compute[73007]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)
Aug 15 17:58:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:58:46 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:58:46 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:58:46 user nova-compute[73007]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 (non-flash)
Aug 15 17:58:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c678dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034'): ({'sdf'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Removing single pathed devices sdf {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e1c0b-94d4-49e0-b23e-08c1b5a4f821]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bc83ef-3604-4e9f-963c-48f4d5eaf5e1]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Flushing IO for device /dev/sdf {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe03c378-ef73-4fae-be42-873dd012337a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4cb7f2-42a7-48b7-b7a7-5945090f5a2b]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb0498c-ec33-4455-beae-d1ec761f3dbd]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd10d6b4-9408-42fa-889b-4422d9abc413]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034, portal: 172.16.0.220,3260]
Aug 15 17:58:46 user nova-compute[73007]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034, portal: 172.16.0.220,3260] successful.
Aug 15 17:58:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a083cf2e-6c3f-475a-a379-bdfeadd6a034 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15d8f7-7417-430a-977f-f5bf33af3943]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== disconnect_volume: return (373ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:58:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:58:47 user nova-compute[73007]: DEBUG nova.objects.instance [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:58:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e566a4ff-be91-462c-9a5d-8f45433e27c9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.171s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:58:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:58:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:06 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 17:59:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 17:59:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:09 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:09 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 17:59:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 17:59:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 17:59:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 17:59:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:59:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 17:59:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 17:59:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "28635f62-bb70-454f-ab7a-c40e48ba2950" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:16 user nova-compute[73007]: INFO nova.compute.manager [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Terminating instance
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-f79a81b5-f2cf-4dc0-89a1-547179856dbf req-bc6d0e47-89cc-4c1f-861e-91e7c072217d service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received event network-vif-unplugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f79a81b5-f2cf-4dc0-89a1-547179856dbf req-bc6d0e47-89cc-4c1f-861e-91e7c072217d service nova] Acquiring lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f79a81b5-f2cf-4dc0-89a1-547179856dbf req-bc6d0e47-89cc-4c1f-861e-91e7c072217d service nova] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f79a81b5-f2cf-4dc0-89a1-547179856dbf req-bc6d0e47-89cc-4c1f-861e-91e7c072217d service nova] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-f79a81b5-f2cf-4dc0-89a1-547179856dbf req-bc6d0e47-89cc-4c1f-861e-91e7c072217d service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] No waiting events found dispatching network-vif-unplugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-f79a81b5-f2cf-4dc0-89a1-547179856dbf req-bc6d0e47-89cc-4c1f-861e-91e7c072217d service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received event network-vif-unplugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Instance destroyed successfully.
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'resources' on Instance uuid 28635f62-bb70-454f-ab7a-c40e48ba2950 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-468031183',display_name='tempest-TestVolumeBootPattern-volume-backed-server-468031183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-468031183',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCeLFsG2e8bauw7/mxxyUA+2AowhFfO5TuGjjgxATqYoVhx8pEyfnHSefCAuC+Js0v/IoiaU5y+P5kAWBvbmMNjqb/c0gU3uRFkQ/gheaDk9YScOI/ODxPYZ3b6qIlTxg==',key_name='tempest-keypair-947905252',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-bvcz0ig0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=28635f62-bb70-454f-ab7a-c40e48ba2950,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "address": "fa:16:3e:a1:b6:a9", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a77f07-1a", "ovs_interfaceid": "45a77f07-1a76-4b20-ad45-4e2f30e44f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=45a77f07-1a76-4b20-ad45-4e2f30e44f81,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a77f07-1a') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG os_vif [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=45a77f07-1a76-4b20-ad45-4e2f30e44f81,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a77f07-1a') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45a77f07-1a, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:59:16 user nova-compute[73007]: INFO os_vif [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:b6:a9,bridge_name='br-int',has_traffic_filtering=True,id=45a77f07-1a76-4b20-ad45-4e2f30e44f81,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a77f07-1a')
Aug 15 17:59:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yLMtZAuV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:59:16 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:59:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca67b3e-228e-43fb-9fa7-0b167f0a119f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faf0a06-1d21-4b03-9b37-c2dddc318a5d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:17 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:59:17 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:59:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:17 user nova-compute[73007]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 (non-flash)
Aug 15 17:59:17 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:59:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c416dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[27536866-27da-47ee-a146-83fb22a5e553]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2b3c21-551d-4efb-849f-3ce53dc40be3]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd7dff0-c4a0-4349-a05f-a1045f84696b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d025484-ca33-4d0b-b3b5-b2143b55a6b9]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23835643539636666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_984bb5b8') {{(pid=84257) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 17:59:17 user nova-compute[73007]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23835643539636666
Aug 15 17:59:17 user nova-compute[73007]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_984bb5b8
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cced2e-e851-4f89-9b8a-810f386decfc]: (4, None) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a669332-4e6d-4665-a41b-85da09b8a60f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be7044-e38e-4da0-95d8-94d6f3878fa8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208, portal: 172.16.0.220,3260]
Aug 15 17:59:17 user nova-compute[73007]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208, portal: 172.16.0.220,3260] successful.
Aug 15 17:59:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:17 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:59:17 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 17:59:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7427MB free_disk=25.227642059326172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2edbf841-b58b-42cf-875b-c211698d6208 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac45a2a-21d7-4b03-8787-c3f87c1bfc94]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.815s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== disconnect_volume: return (817ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:59:17 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Deleting instance files /opt/stack/data/nova/instances/28635f62-bb70-454f-ab7a-c40e48ba2950_del
Aug 15 17:59:17 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Deletion of /opt/stack/data/nova/instances/28635f62-bb70-454f-ab7a-c40e48ba2950_del complete
Aug 15 17:59:17 user nova-compute[73007]: INFO nova.compute.manager [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Took 1.86 seconds to destroy the instance on the hypervisor.
Aug 15 17:59:17 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 17:59:17 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 28635f62-bb70-454f-ab7a-c40e48ba2950 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 91cffe2e-5666-471f-a45f-1c14ea6668dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 029c5519-9937-439c-9fc7-f1bad76d26f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.887s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-50b54daf-5a32-4bff-a8d8-17b67467352d req-582513d1-3225-4de5-a110-aff3392575bd service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received event network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-50b54daf-5a32-4bff-a8d8-17b67467352d req-582513d1-3225-4de5-a110-aff3392575bd service nova] Acquiring lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-50b54daf-5a32-4bff-a8d8-17b67467352d req-582513d1-3225-4de5-a110-aff3392575bd service nova] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-50b54daf-5a32-4bff-a8d8-17b67467352d req-582513d1-3225-4de5-a110-aff3392575bd service nova] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-50b54daf-5a32-4bff-a8d8-17b67467352d req-582513d1-3225-4de5-a110-aff3392575bd service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] No waiting events found dispatching network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 17:59:18 user nova-compute[73007]: WARNING nova.compute.manager [req-50b54daf-5a32-4bff-a8d8-17b67467352d req-582513d1-3225-4de5-a110-aff3392575bd service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received unexpected event network-vif-plugged-45a77f07-1a76-4b20-ad45-4e2f30e44f81 for instance with vm_state active and task_state deleting.
Aug 15 17:59:19 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 17:59:19 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Took 1.57 seconds to deallocate network for instance.
Aug 15 17:59:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 17:59:20 user nova-compute[73007]: INFO nova.compute.manager [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Took 0.93 seconds to detach 1 volumes for instance.
Aug 15 17:59:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Deleting volume: 2edbf841-b58b-42cf-875b-c211698d6208 {{(pid=73007) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 17:59:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-1b214bcb-9d67-4426-a506-c1f081d98cbe req-5f29342c-3e81-4408-8bc0-699a24c4935a service nova] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Received event network-vif-deleted-45a77f07-1a76-4b20-ad45-4e2f30e44f81 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 17:59:20 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 17:59:20 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 17:59:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:21 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Deleted allocations for instance 28635f62-bb70-454f-ab7a-c40e48ba2950
Aug 15 17:59:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1900bb7c-a074-40a3-a514-4c0e00fd7ae9 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "28635f62-bb70-454f-ab7a-c40e48ba2950" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.151s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:59:31 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122356.8759954, 28635f62-bb70-454f-ab7a-c40e48ba2950 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 17:59:31 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] VM Stopped (Lifecycle Event)
Aug 15 17:59:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-26908fc6-0eac-4074-9dd0-5aa051e8a22d None None] [instance: 28635f62-bb70-454f-ab7a-c40e48ba2950] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:59:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:59:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:59:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:59:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:59:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:39 user nova-compute[73007]: DEBUG nova.objects.instance [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:59:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:40 user nova-compute[73007]: INFO nova.compute.manager [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attaching volume 57764368-7f05-4fa4-a7a2-261b17e6ed9b to /dev/vdb
Aug 15 17:59:40 user nova-compute[73007]: DEBUG os_brick.utils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbe816d-1bc7-4f76-bd7c-af929a978c56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5ec86-991c-4365-a918-26d43f9e0d0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebac89b-c552-4227-af8a-3e0aeb7c5d0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[165f9af0-d4b5-42ff-a945-e5af41566c4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 17:59:40 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 17:59:40 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5fa764-aef8-4476-bcc0-c1292ca63261]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG os_brick.utils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:59:40 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating existing volume attachment record: 14c1d41a-0a35-4a46-88f4-1752385459a1 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:41 user nova-compute[73007]: INFO nova.compute.manager [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Detaching volume 4269b050-c1e1-4e6f-9bda-28e21f5e0f62
Aug 15 17:59:41 user nova-compute[73007]: INFO nova.virt.block_device [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Attempting to driver detach volume 4269b050-c1e1-4e6f-9bda-28e21f5e0f62 from mountpoint /dev/vdb
Aug 15 17:59:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Attempting to detach device vdb from instance 91cffe2e-5666-471f-a45f-1c14ea6668dd from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:59:41 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:59:41 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:59:41 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:59:41 user nova-compute[73007]:   <serial>4269b050-c1e1-4e6f-9bda-28e21f5e0f62</serial>
Aug 15 17:59:41 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 17:59:41 user nova-compute[73007]: </disk>
Aug 15 17:59:41 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:59:41 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully detached device vdb from instance 91cffe2e-5666-471f-a45f-1c14ea6668dd from the persistent domain config.
Aug 15 17:59:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91cffe2e-5666-471f-a45f-1c14ea6668dd from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:59:41 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:59:41 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 17:59:41 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:59:41 user nova-compute[73007]:   <serial>4269b050-c1e1-4e6f-9bda-28e21f5e0f62</serial>
Aug 15 17:59:41 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 17:59:41 user nova-compute[73007]: </disk>
Aug 15 17:59:41 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 17:59:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122382.2792437, 91cffe2e-5666-471f-a45f-1c14ea6668dd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:59:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully detached device vdb from instance 91cffe2e-5666-471f-a45f-1c14ea6668dd from the live domain config.
Aug 15 17:59:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IzbCoqJy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:59:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b310cb-63d2-4195-831e-7f80694c943d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[872703b6-9cc2-412b-9670-0ec8355c0630]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:42 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:59:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:42 user nova-compute[73007]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 (non-flash)
Aug 15 17:59:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1162503370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[383f4619-a984-434c-b746-93b87fcd01b1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[86240178-00bb-4f48-8079-ca4fba8bd291]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef6dc6-70d3-4306-b781-7bd62ff27426]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a572b73-49f1-430a-970e-31f49385e0fc]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9e245c-2468-4da0-9c02-11ba9664354a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad94445-2c67-4cd2-a3d4-6f8f0fb7fb75]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260]
Aug 15 17:59:42 user nova-compute[73007]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62, portal: 172.16.0.220,3260] successful.
Aug 15 17:59:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4269b050-c1e1-4e6f-9bda-28e21f5e0f62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fadb15-ce9e-46e6-a7d0-9429c81b70d4]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== disconnect_volume: return (291ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:59:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:59:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'flavor' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:59:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a2cea22b-18ff-4a34-b36d-488c666602e5 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.764s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRGlZXrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:59:49 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:59:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:59:49 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:59:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:59:49 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85e144e-085b-45c2-9f89-8d90fe227f40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 17:59:49 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[db292e8a-dc96-4298-adb9-49c727e09c91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b] added
Aug 15 17:59:49 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[277a5e42-c0f2-4e01-81bf-8142255a3449]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:49 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4780a7-4299-4168-b988-571e4ece0736]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRGlZXrV {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRGlZXrV" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[19488aaf-3c91-4ec5-aa07-f6831ebdef4d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRGlZXrV'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea7f5b-8bf5-4f41-b616-cb93fd6470c0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5b9f20-9356-407b-8533-e90a3ea64e66]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98e67b6-36f4-45e6-b5c9-1f46f0077789]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b, portal: 172.16.0.220,3260]
Aug 15 17:59:50 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b, portal: 172.16.0.220,3260] successful.
Aug 15 17:59:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c56800-a1c2-4322-aef2-78d203cfd61e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b401dfa-2aed-49e2-b4af-7ca5ba2dc623]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:50 user nova-compute[73007]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b (non-flash)
Aug 15 17:59:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:50 user nova-compute[73007]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b (non-flash)
Aug 15 17:59:50 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa7671-3b7d-4f9b-9252-849789a65436]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 17:59:50 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRGlZXrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23537333564326362', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537333564326362', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG nova.objects.instance [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 17:59:51 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:59:51 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:59:51 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:59:51 user nova-compute[73007]:   <serial>57764368-7f05-4fa4-a7a2-261b17e6ed9b</serial>
Aug 15 17:59:51 user nova-compute[73007]: </disk>
Aug 15 17:59:51 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No VIF found with MAC fa:16:3e:6b:92:1b, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-fb537402-bfb5-4074-b742-40685f6810d9 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.870s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:53 user nova-compute[73007]: INFO nova.compute.manager [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Detaching volume 57764368-7f05-4fa4-a7a2-261b17e6ed9b
Aug 15 17:59:53 user nova-compute[73007]: INFO nova.virt.block_device [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attempting to driver detach volume 57764368-7f05-4fa4-a7a2-261b17e6ed9b from mountpoint /dev/vdb
Aug 15 17:59:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Attempting to detach device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 17:59:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:59:53 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:59:53 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:59:53 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:59:53 user nova-compute[73007]:   <serial>57764368-7f05-4fa4-a7a2-261b17e6ed9b</serial>
Aug 15 17:59:53 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:59:53 user nova-compute[73007]: </disk>
Aug 15 17:59:53 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:59:53 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully detached device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the persistent domain config.
Aug 15 17:59:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 17:59:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 17:59:53 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 17:59:53 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 17:59:53 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 17:59:53 user nova-compute[73007]:   <serial>57764368-7f05-4fa4-a7a2-261b17e6ed9b</serial>
Aug 15 17:59:53 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 17:59:53 user nova-compute[73007]: </disk>
Aug 15 17:59:53 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 17:59:53 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122393.9971483, 029c5519-9937-439c-9fc7-f1bad76d26f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 17:59:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully detached device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the live domain config.
Aug 15 17:59:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRGlZXrV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 17:59:54 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[61118f97-0b86-408c-b07f-e871ff8ed129]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea74411-58dd-4809-a728-bb05d2590633]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:54 user nova-compute[73007]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b (non-flash)
Aug 15 17:59:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 17:59:54 user nova-compute[73007]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b (non-flash)
Aug 15 17:59:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11625037f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e82d30-2468-425a-bff9-df69eb2038b3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[06290664-8913-4326-9700-0b995b9401bd]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a1f301-9023-4fc5-a3d4-1a0081aa6402]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f522b-b057-4f28-9827-314c45756dad]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec500f8-fb35-4c73-9284-3479ee66ffca]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[89867d88-eb89-4813-972a-a8cdf5ec5a6f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b, portal: 172.16.0.220,3260]
Aug 15 17:59:54 user nova-compute[73007]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b, portal: 172.16.0.220,3260] successful.
Aug 15 17:59:54 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57764368-7f05-4fa4-a7a2-261b17e6ed9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c410474-4c65-4d52-acfe-135bde6580c7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== disconnect_volume: return (306ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 17:59:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 17:59:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:55 user nova-compute[73007]: DEBUG nova.objects.instance [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 17:59:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5dc44ddc-01d3-440d-b34f-fa585eb031e6 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.829s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 582f3e3e-a05e-48dd-803d-b87a6eeda045 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid accaba3e-7f1d-4638-8338-453f429a0c40 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid bec479f1-341e-4879-8280-8f3bc9b9e5a0 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "accaba3e-7f1d-4638-8338-453f429a0c40" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "accaba3e-7f1d-4638-8338-453f429a0c40" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "accaba3e-7f1d-4638-8338-453f429a0c40" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 17:59:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 17:59:59 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 17:59:59 user nova-compute[73007]: INFO nova.compute.manager [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] instance snapshotting
Aug 15 17:59:59 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Beginning live snapshot process
Aug 15 17:59:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json -f qcow2 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 17:59:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 17:59:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json -f qcow2 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.227s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv8q6i8ps/a4a6b8dd43134cf7b353de2fc69d4540.delta 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv8q6i8ps/a4a6b8dd43134cf7b353de2fc69d4540.delta 1073741824" returned: 0 in 0.063s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 18:00:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 18:00:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] COPY block job progress, current cursor: 46989312 final cursor: 75497472 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 18:00:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 18:00:02 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 18:00:02 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 18:00:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv8q6i8ps/a4a6b8dd43134cf7b353de2fc69d4540.delta /opt/stack/data/nova/instances/snapshots/tmpv8q6i8ps/a4a6b8dd43134cf7b353de2fc69d4540 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv8q6i8ps/a4a6b8dd43134cf7b353de2fc69d4540.delta /opt/stack/data/nova/instances/snapshots/tmpv8q6i8ps/a4a6b8dd43134cf7b353de2fc69d4540" returned: 0 in 0.983s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Snapshot extracted, beginning image upload
Aug 15 18:00:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:06 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Snapshot image upload complete
Aug 15 18:00:06 user nova-compute[73007]: INFO nova.compute.manager [None req-c4add158-f94c-41d7-badf-560190b24211 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Took 6.94 seconds to snapshot the instance on the hypervisor.
Aug 15 18:00:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:09 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:09 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:00:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:00:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:00:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updating instance_info_cache with network_info: [{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:10 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:00:10 user nova-compute[73007]: INFO nova.compute.claims [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Claim successful on node user
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:00:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.policy [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a4ecddd550e412e83798beb94d71db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dc4bf210044c769da4afeb6fbb7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:00:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Creating image(s)
Aug 15 18:00:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "/opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "/opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.222s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk 1073741824" returned: 0 in 0.096s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.208s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Successfully created port: cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Cannot resize image /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'migration_context' on Instance uuid 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Ensure instance console log exists: /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.neutron [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Successfully updated port: cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquired lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.neutron [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-2b2f8f65-99ba-4fb4-b76c-1003428b31ef req-6797ec9a-9521-41e5-9e89-11ce38cb4535 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-changed-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-2b2f8f65-99ba-4fb4-b76c-1003428b31ef req-6797ec9a-9521-41e5-9e89-11ce38cb4535 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Refreshing instance network info cache due to event network-changed-cc02a4b7-09c0-4dee-9f52-7546e80dad26. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2b2f8f65-99ba-4fb4-b76c-1003428b31ef req-6797ec9a-9521-41e5-9e89-11ce38cb4535 service nova] Acquiring lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.neutron [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.neutron [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updating instance_info_cache with network_info: [{"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Releasing lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Instance network_info: |[{"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2b2f8f65-99ba-4fb4-b76c-1003428b31ef req-6797ec9a-9521-41e5-9e89-11ce38cb4535 service nova] Acquired lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-2b2f8f65-99ba-4fb4-b76c-1003428b31ef req-6797ec9a-9521-41e5-9e89-11ce38cb4535 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Refreshing network info cache for port cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Start _get_guest_xml network_info=[{"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:00:14 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:00:14 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1317595518',display_name='tempest-TestStampPattern-server-1317595518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1317595518',id=37,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Wzpkb4d/FqkLpOgMs40DkQZ4S3W/bdhb1IceHH+6YDRcBBgEJz/OwRQD9/KRHQQ/5ClKqrnorBoWo+ErrhtxAJD56iE9sp7wIWJnjhB08h2DT6wHTAeyjVek0+ZKfdQ==',key_name='tempest-TestStampPattern-319626008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9dc4bf210044c769da4afeb6fbb7607',ramdisk_id='',reservation_id='r-8z4crird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1140446429',owner_user_name='tempest-TestStampPattern-1140446429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:00:12Z,user_data=None,user_id='0a4ecddd550e412e83798beb94d71db6',uuid=5ed0a68e-b82d-4aa9-b7d6-01aaa573c541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converting VIF {"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ca:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc02a4b7-09c0-4dee-9f52-7546e80dad26,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02a4b7-09') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.objects.instance [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:00:14 user nova-compute[73007]:   <uuid>5ed0a68e-b82d-4aa9-b7d6-01aaa573c541</uuid>
Aug 15 18:00:14 user nova-compute[73007]:   <name>instance-00000025</name>
Aug 15 18:00:14 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:00:14 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:00:14 user nova-compute[73007]:   <metadata>
Aug 15 18:00:14 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:00:14 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:00:14 user nova-compute[73007]:       <nova:name>tempest-TestStampPattern-server-1317595518</nova:name>
Aug 15 18:00:14 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:00:14</nova:creationTime>
Aug 15 18:00:14 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:00:14 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:00:14 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:00:14 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:00:14 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:00:14 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:00:14 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:00:14 user nova-compute[73007]:       <nova:owner>
Aug 15 18:00:14 user nova-compute[73007]:         <nova:user uuid="0a4ecddd550e412e83798beb94d71db6">tempest-TestStampPattern-1140446429-project-member</nova:user>
Aug 15 18:00:14 user nova-compute[73007]:         <nova:project uuid="f9dc4bf210044c769da4afeb6fbb7607">tempest-TestStampPattern-1140446429</nova:project>
Aug 15 18:00:14 user nova-compute[73007]:       </nova:owner>
Aug 15 18:00:14 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:00:14 user nova-compute[73007]:       <nova:ports>
Aug 15 18:00:14 user nova-compute[73007]:         <nova:port uuid="cc02a4b7-09c0-4dee-9f52-7546e80dad26">
Aug 15 18:00:14 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 18:00:14 user nova-compute[73007]:         </nova:port>
Aug 15 18:00:14 user nova-compute[73007]:       </nova:ports>
Aug 15 18:00:14 user nova-compute[73007]:     </nova:instance>
Aug 15 18:00:14 user nova-compute[73007]:   </metadata>
Aug 15 18:00:14 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:00:14 user nova-compute[73007]:     <system>
Aug 15 18:00:14 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:00:14 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:00:14 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:00:14 user nova-compute[73007]:       <entry name="serial">5ed0a68e-b82d-4aa9-b7d6-01aaa573c541</entry>
Aug 15 18:00:14 user nova-compute[73007]:       <entry name="uuid">5ed0a68e-b82d-4aa9-b7d6-01aaa573c541</entry>
Aug 15 18:00:14 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:00:14 user nova-compute[73007]:     </system>
Aug 15 18:00:14 user nova-compute[73007]:   </sysinfo>
Aug 15 18:00:14 user nova-compute[73007]:   <os>
Aug 15 18:00:14 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:00:14 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:00:14 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:00:14 user nova-compute[73007]:   </os>
Aug 15 18:00:14 user nova-compute[73007]:   <features>
Aug 15 18:00:14 user nova-compute[73007]:     <acpi/>
Aug 15 18:00:14 user nova-compute[73007]:     <apic/>
Aug 15 18:00:14 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:00:14 user nova-compute[73007]:   </features>
Aug 15 18:00:14 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:00:14 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:00:14 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:00:14 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:00:14 user nova-compute[73007]:   </clock>
Aug 15 18:00:14 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:00:14 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:00:14 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:00:14 user nova-compute[73007]:   </cpu>
Aug 15 18:00:14 user nova-compute[73007]:   <devices>
Aug 15 18:00:14 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:00:14 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:00:14 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk"/>
Aug 15 18:00:14 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:00:14 user nova-compute[73007]:     </disk>
Aug 15 18:00:14 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:00:14 user nova-compute[73007]:       <mac address="fa:16:3e:1d:ca:a3"/>
Aug 15 18:00:14 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:00:14 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:00:14 user nova-compute[73007]:       <target dev="tapcc02a4b7-09"/>
Aug 15 18:00:14 user nova-compute[73007]:     </interface>
Aug 15 18:00:14 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:00:14 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/console.log" append="off"/>
Aug 15 18:00:14 user nova-compute[73007]:     </serial>
Aug 15 18:00:14 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:00:14 user nova-compute[73007]:     <video>
Aug 15 18:00:14 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:00:14 user nova-compute[73007]:     </video>
Aug 15 18:00:14 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:00:14 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:00:14 user nova-compute[73007]:     </rng>
Aug 15 18:00:14 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:00:14 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:00:14 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:00:14 user nova-compute[73007]:     </memballoon>
Aug 15 18:00:14 user nova-compute[73007]:   </devices>
Aug 15 18:00:14 user nova-compute[73007]: </domain>
Aug 15 18:00:14 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1317595518',display_name='tempest-TestStampPattern-server-1317595518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1317595518',id=37,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Wzpkb4d/FqkLpOgMs40DkQZ4S3W/bdhb1IceHH+6YDRcBBgEJz/OwRQD9/KRHQQ/5ClKqrnorBoWo+ErrhtxAJD56iE9sp7wIWJnjhB08h2DT6wHTAeyjVek0+ZKfdQ==',key_name='tempest-TestStampPattern-319626008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9dc4bf210044c769da4afeb6fbb7607',ramdisk_id='',reservation_id='r-8z4crird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1140446429',owner_user_name='tempest-TestStampPattern-1140446429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:00:12Z,user_data=None,user_id='0a4ecddd550e412e83798beb94d71db6',uuid=5ed0a68e-b82d-4aa9-b7d6-01aaa573c541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converting VIF {"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ca:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc02a4b7-09c0-4dee-9f52-7546e80dad26,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02a4b7-09') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG os_vif [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ca:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc02a4b7-09c0-4dee-9f52-7546e80dad26,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02a4b7-09') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc02a4b7-09, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc02a4b7-09, col_values=(('external_ids', {'iface-id': 'cc02a4b7-09c0-4dee-9f52-7546e80dad26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:ca:a3', 'vm-uuid': '5ed0a68e-b82d-4aa9-b7d6-01aaa573c541'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:14 user nova-compute[73007]: INFO os_vif [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ca:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc02a4b7-09c0-4dee-9f52-7546e80dad26,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02a4b7-09')
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No VIF found with MAC fa:16:3e:1d:ca:a3, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-2b2f8f65-99ba-4fb4-b76c-1003428b31ef req-6797ec9a-9521-41e5-9e89-11ce38cb4535 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updated VIF entry in instance network info cache for port cc02a4b7-09c0-4dee-9f52-7546e80dad26. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-2b2f8f65-99ba-4fb4-b76c-1003428b31ef req-6797ec9a-9521-41e5-9e89-11ce38cb4535 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updating instance_info_cache with network_info: [{"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2b2f8f65-99ba-4fb4-b76c-1003428b31ef req-6797ec9a-9521-41e5-9e89-11ce38cb4535 service nova] Releasing lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-7df5a57d-9094-48a0-b934-a976de55f0ed req-cfc75a51-c675-41bd-9124-485293f4cdb2 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7df5a57d-9094-48a0-b934-a976de55f0ed req-cfc75a51-c675-41bd-9124-485293f4cdb2 service nova] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7df5a57d-9094-48a0-b934-a976de55f0ed req-cfc75a51-c675-41bd-9124-485293f4cdb2 service nova] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7df5a57d-9094-48a0-b934-a976de55f0ed req-cfc75a51-c675-41bd-9124-485293f4cdb2 service nova] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-7df5a57d-9094-48a0-b934-a976de55f0ed req-cfc75a51-c675-41bd-9124-485293f4cdb2 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] No waiting events found dispatching network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:00:17 user nova-compute[73007]: WARNING nova.compute.manager [req-7df5a57d-9094-48a0-b934-a976de55f0ed req-cfc75a51-c675-41bd-9124-485293f4cdb2 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received unexpected event network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 for instance with vm_state building and task_state spawning.
Aug 15 18:00:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122418.9492939, 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:00:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] VM Resumed (Lifecycle Event)
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-43951ef5-969d-4cfb-8078-e9203336deba req-d712ac7e-23ff-4e35-a546-efbc7dadf9dc service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-43951ef5-969d-4cfb-8078-e9203336deba req-d712ac7e-23ff-4e35-a546-efbc7dadf9dc service nova] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-43951ef5-969d-4cfb-8078-e9203336deba req-d712ac7e-23ff-4e35-a546-efbc7dadf9dc service nova] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-43951ef5-969d-4cfb-8078-e9203336deba req-d712ac7e-23ff-4e35-a546-efbc7dadf9dc service nova] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-43951ef5-969d-4cfb-8078-e9203336deba req-d712ac7e-23ff-4e35-a546-efbc7dadf9dc service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] No waiting events found dispatching network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:00:19 user nova-compute[73007]: WARNING nova.compute.manager [req-43951ef5-969d-4cfb-8078-e9203336deba req-d712ac7e-23ff-4e35-a546-efbc7dadf9dc service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received unexpected event network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 for instance with vm_state building and task_state spawning.
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:19 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:00:19 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7786MB free_disk=25.14716339111328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Instance spawned successfully.
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122418.9499202, 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:00:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] VM Started (Lifecycle Event)
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:19 user nova-compute[73007]: INFO nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Took 7.64 seconds to spawn the instance on the hypervisor.
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 91cffe2e-5666-471f-a45f-1c14ea6668dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 029c5519-9937-439c-9fc7-f1bad76d26f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:00:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:00:19 user nova-compute[73007]: INFO nova.compute.manager [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Took 8.87 seconds to build instance.
Aug 15 18:00:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-34e686ce-deea-4945-ab84-1d6438c7394c tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.173s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:00:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:00:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:00:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:00:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:23 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:00:23 user nova-compute[73007]: INFO nova.compute.claims [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Claim successful on node user
Aug 15 18:00:23 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:00:23 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:00:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:00:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:00:24 user nova-compute[73007]: INFO nova.virt.block_device [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Booting with volume 2681b1cb-b2a5-412b-b8bc-e631cb3b537b at /dev/vda
Aug 15 18:00:24 user nova-compute[73007]: DEBUG nova.policy [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cd910b3e8bf406f8512b3470f6eaca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eebca3ef0a45788b0dfbc03b01fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG os_brick.utils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[86edacb4-5931-40e4-9842-b9504a5cfc62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee44258f-92a5-4455-ba83-5f26d20e6d0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a05f14-7b8e-4774-956d-e3f769387a79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c915b4ad-8d38-4e8f-9c8d-613003938158]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:00:24 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:00:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef4e32b-4b4e-496e-ae93-33c8d3f5e72d]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG os_brick.utils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Updating existing volume attachment record: 78dd1617-bdea-4883-8153-b3c602a225cd {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:00:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Successfully created port: c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Successfully updated port: c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquired lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-77657558-9abd-4cc6-aa97-ba3c82e0f4ec req-c8d3626d-488a-484d-aab3-0d4758bf918b service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-changed-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-77657558-9abd-4cc6-aa97-ba3c82e0f4ec req-c8d3626d-488a-484d-aab3-0d4758bf918b service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Refreshing instance network info cache due to event network-changed-c032d20a-c59f-4c6c-8377-01ca95aa4c4a. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-77657558-9abd-4cc6-aa97-ba3c82e0f4ec req-c8d3626d-488a-484d-aab3-0d4758bf918b service nova] Acquiring lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Updating instance_info_cache with network_info: [{"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Releasing lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Instance network_info: |[{"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-77657558-9abd-4cc6-aa97-ba3c82e0f4ec req-c8d3626d-488a-484d-aab3-0d4758bf918b service nova] Acquired lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:00:26 user nova-compute[73007]: DEBUG nova.network.neutron [req-77657558-9abd-4cc6-aa97-ba3c82e0f4ec req-c8d3626d-488a-484d-aab3-0d4758bf918b service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Refreshing network info cache for port c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:00:27 user nova-compute[73007]: DEBUG nova.network.neutron [req-77657558-9abd-4cc6-aa97-ba3c82e0f4ec req-c8d3626d-488a-484d-aab3-0d4758bf918b service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Updated VIF entry in instance network info cache for port c032d20a-c59f-4c6c-8377-01ca95aa4c4a. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:00:27 user nova-compute[73007]: DEBUG nova.network.neutron [req-77657558-9abd-4cc6-aa97-ba3c82e0f4ec req-c8d3626d-488a-484d-aab3-0d4758bf918b service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Updating instance_info_cache with network_info: [{"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:00:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-77657558-9abd-4cc6-aa97-ba3c82e0f4ec req-c8d3626d-488a-484d-aab3-0d4758bf918b service nova] Releasing lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:00:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:00:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:31 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:00:31 user nova-compute[73007]: INFO nova.compute.claims [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Claim successful on node user
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:32 user nova-compute[73007]: INFO nova.compute.manager [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Terminating instance
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:00:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.policy [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f886ee6939504c4b9a406cedb9a65acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f94edb7a50c4e0e97ddc96c5c0028fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-180ab6a8-0421-4225-a217-2266959deefb req-d5b811b1-b1a0-49a6-9cd4-ed7bcc5de5be service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-unplugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-180ab6a8-0421-4225-a217-2266959deefb req-d5b811b1-b1a0-49a6-9cd4-ed7bcc5de5be service nova] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-180ab6a8-0421-4225-a217-2266959deefb req-d5b811b1-b1a0-49a6-9cd4-ed7bcc5de5be service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-180ab6a8-0421-4225-a217-2266959deefb req-d5b811b1-b1a0-49a6-9cd4-ed7bcc5de5be service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-180ab6a8-0421-4225-a217-2266959deefb req-d5b811b1-b1a0-49a6-9cd4-ed7bcc5de5be service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] No waiting events found dispatching network-vif-unplugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-180ab6a8-0421-4225-a217-2266959deefb req-d5b811b1-b1a0-49a6-9cd4-ed7bcc5de5be service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-unplugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:00:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Creating image(s)
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Instance destroyed successfully.
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.objects.instance [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'resources' on Instance uuid 91cffe2e-5666-471f-a45f-1c14ea6668dd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T17:54:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-740136733',display_name='tempest-ServerActionsTestOtherA-server-1710520802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-740136733',id=33,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgdIs/eg2C8hauxoxVn9GAyoaiKlWml9Ipd/bLniZNf2EVQLJEHP9kIsjS/Jx6/BcyOgdQkj1N/mtGmcqCV+UW+HVYjF0SpmAzPzt3hJlQgzHSNIQFR73eqoWQSg1o/Mw==',key_name='tempest-keypair-1434873340',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:57:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-8h08cfb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:57:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=91cffe2e-5666-471f-a45f-1c14ea6668dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "address": "fa:16:3e:52:42:06", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b7b0e14-49", "ovs_interfaceid": "3b7b0e14-4976-4854-9b48-40afa4b5f430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG os_vif [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b7b0e14-49, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:00:32 user nova-compute[73007]: INFO os_vif [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:42:06,bridge_name='br-int',has_traffic_filtering=True,id=3b7b0e14-4976-4854-9b48-40afa4b5f430,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b7b0e14-49')
Aug 15 18:00:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Deleting instance files /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd_del
Aug 15 18:00:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Deletion of /opt/stack/data/nova/instances/91cffe2e-5666-471f-a45f-1c14ea6668dd_del complete
Aug 15 18:00:32 user nova-compute[73007]: INFO nova.compute.manager [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 18:00:32 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:00:32 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.241s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk 1073741824" returned: 0 in 0.067s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Successfully created port: f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.230s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Cannot resize image /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'migration_context' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Ensure instance console log exists: /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:00:34 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Took 1.24 seconds to deallocate network for instance.
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Successfully updated port: f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquired lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-9e9549a5-06bc-4048-a6fb-145dda5998bd req-6e3414a9-d12d-4a8c-b1b8-b18fa400a6cc service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-changed-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-9e9549a5-06bc-4048-a6fb-145dda5998bd req-6e3414a9-d12d-4a8c-b1b8-b18fa400a6cc service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Refreshing instance network info cache due to event network-changed-f98c5145-23fc-4228-bf00-2a399bb280f0. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e9549a5-06bc-4048-a6fb-145dda5998bd req-6e3414a9-d12d-4a8c-b1b8-b18fa400a6cc service nova] Acquiring lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-e12b086c-db52-49bb-b1fb-8ed991e8e635 req-c3bfe5a5-b008-4c35-bfc7-c64bf5245bb8 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e12b086c-db52-49bb-b1fb-8ed991e8e635 req-c3bfe5a5-b008-4c35-bfc7-c64bf5245bb8 service nova] Acquiring lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e12b086c-db52-49bb-b1fb-8ed991e8e635 req-c3bfe5a5-b008-4c35-bfc7-c64bf5245bb8 service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e12b086c-db52-49bb-b1fb-8ed991e8e635 req-c3bfe5a5-b008-4c35-bfc7-c64bf5245bb8 service nova] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-e12b086c-db52-49bb-b1fb-8ed991e8e635 req-c3bfe5a5-b008-4c35-bfc7-c64bf5245bb8 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] No waiting events found dispatching network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:00:34 user nova-compute[73007]: WARNING nova.compute.manager [req-e12b086c-db52-49bb-b1fb-8ed991e8e635 req-c3bfe5a5-b008-4c35-bfc7-c64bf5245bb8 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received unexpected event network-vif-plugged-3b7b0e14-4976-4854-9b48-40afa4b5f430 for instance with vm_state deleted and task_state None.
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-e12b086c-db52-49bb-b1fb-8ed991e8e635 req-c3bfe5a5-b008-4c35-bfc7-c64bf5245bb8 service nova] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Received event network-vif-deleted-3b7b0e14-4976-4854-9b48-40afa4b5f430 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:34 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Deleted allocations for instance 91cffe2e-5666-471f-a45f-1c14ea6668dd
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Releasing lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance network_info: |[{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e9549a5-06bc-4048-a6fb-145dda5998bd req-6e3414a9-d12d-4a8c-b1b8-b18fa400a6cc service nova] Acquired lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e9549a5-06bc-4048-a6fb-145dda5998bd req-6e3414a9-d12d-4a8c-b1b8-b18fa400a6cc service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Refreshing network info cache for port f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Start _get_guest_xml network_info=[{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:00:34 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:00:34 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1475833445',display_name='tempest-ServerRescueNegativeTestJSON-server-1475833445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1475833445',id=39,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6C1KYKxf38rOwazJQZLOHCxAe4Mz4s81UJd04jHbux9L0G8Yk3C/k3ldVklTUJR5Ibv+Iv0VuGhVgS70ITXzaektW1NMxhLGHAsQg3vXL66frE4sFgjnqpkdxXMSS8XQ==',key_name='tempest-keypair-1271983282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-m5enh7lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=da287ce9-0600-43be-94aa-038eb1edaf07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=f98c5145-23fc-4228-bf00-2a399bb280f0,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98c5145-23') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'pci_devices' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-461e3121-200b-4354-958c-85d8ea14dad1 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "91cffe2e-5666-471f-a45f-1c14ea6668dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.874s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:00:34 user nova-compute[73007]:   <uuid>da287ce9-0600-43be-94aa-038eb1edaf07</uuid>
Aug 15 18:00:34 user nova-compute[73007]:   <name>instance-00000027</name>
Aug 15 18:00:34 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:00:34 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:00:34 user nova-compute[73007]:   <metadata>
Aug 15 18:00:34 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:00:34 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:00:34 user nova-compute[73007]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1475833445</nova:name>
Aug 15 18:00:34 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:00:34</nova:creationTime>
Aug 15 18:00:34 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:00:34 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:00:34 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:00:34 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:00:34 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:00:34 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:00:34 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:00:34 user nova-compute[73007]:       <nova:owner>
Aug 15 18:00:34 user nova-compute[73007]:         <nova:user uuid="f886ee6939504c4b9a406cedb9a65acc">tempest-ServerRescueNegativeTestJSON-1846740548-project-member</nova:user>
Aug 15 18:00:34 user nova-compute[73007]:         <nova:project uuid="8f94edb7a50c4e0e97ddc96c5c0028fc">tempest-ServerRescueNegativeTestJSON-1846740548</nova:project>
Aug 15 18:00:34 user nova-compute[73007]:       </nova:owner>
Aug 15 18:00:34 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:00:34 user nova-compute[73007]:       <nova:ports>
Aug 15 18:00:34 user nova-compute[73007]:         <nova:port uuid="f98c5145-23fc-4228-bf00-2a399bb280f0">
Aug 15 18:00:34 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 18:00:34 user nova-compute[73007]:         </nova:port>
Aug 15 18:00:34 user nova-compute[73007]:       </nova:ports>
Aug 15 18:00:34 user nova-compute[73007]:     </nova:instance>
Aug 15 18:00:34 user nova-compute[73007]:   </metadata>
Aug 15 18:00:34 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:00:34 user nova-compute[73007]:     <system>
Aug 15 18:00:34 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:00:34 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:00:34 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:00:34 user nova-compute[73007]:       <entry name="serial">da287ce9-0600-43be-94aa-038eb1edaf07</entry>
Aug 15 18:00:34 user nova-compute[73007]:       <entry name="uuid">da287ce9-0600-43be-94aa-038eb1edaf07</entry>
Aug 15 18:00:34 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:00:34 user nova-compute[73007]:     </system>
Aug 15 18:00:34 user nova-compute[73007]:   </sysinfo>
Aug 15 18:00:34 user nova-compute[73007]:   <os>
Aug 15 18:00:34 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:00:34 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:00:34 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:00:34 user nova-compute[73007]:   </os>
Aug 15 18:00:34 user nova-compute[73007]:   <features>
Aug 15 18:00:34 user nova-compute[73007]:     <acpi/>
Aug 15 18:00:34 user nova-compute[73007]:     <apic/>
Aug 15 18:00:34 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:00:34 user nova-compute[73007]:   </features>
Aug 15 18:00:34 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:00:34 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:00:34 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:00:34 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:00:34 user nova-compute[73007]:   </clock>
Aug 15 18:00:34 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:00:34 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:00:34 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:00:34 user nova-compute[73007]:   </cpu>
Aug 15 18:00:34 user nova-compute[73007]:   <devices>
Aug 15 18:00:34 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:00:34 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:00:34 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk"/>
Aug 15 18:00:34 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:00:34 user nova-compute[73007]:     </disk>
Aug 15 18:00:34 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:00:34 user nova-compute[73007]:       <mac address="fa:16:3e:9e:3c:6d"/>
Aug 15 18:00:34 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:00:34 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:00:34 user nova-compute[73007]:       <target dev="tapf98c5145-23"/>
Aug 15 18:00:34 user nova-compute[73007]:     </interface>
Aug 15 18:00:34 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:00:34 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/console.log" append="off"/>
Aug 15 18:00:34 user nova-compute[73007]:     </serial>
Aug 15 18:00:34 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:00:34 user nova-compute[73007]:     <video>
Aug 15 18:00:34 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:00:34 user nova-compute[73007]:     </video>
Aug 15 18:00:34 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:00:34 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:00:34 user nova-compute[73007]:     </rng>
Aug 15 18:00:34 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:00:34 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:00:34 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:00:34 user nova-compute[73007]:     </memballoon>
Aug 15 18:00:34 user nova-compute[73007]:   </devices>
Aug 15 18:00:34 user nova-compute[73007]: </domain>
Aug 15 18:00:34 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1475833445',display_name='tempest-ServerRescueNegativeTestJSON-server-1475833445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1475833445',id=39,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6C1KYKxf38rOwazJQZLOHCxAe4Mz4s81UJd04jHbux9L0G8Yk3C/k3ldVklTUJR5Ibv+Iv0VuGhVgS70ITXzaektW1NMxhLGHAsQg3vXL66frE4sFgjnqpkdxXMSS8XQ==',key_name='tempest-keypair-1271983282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-m5enh7lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=da287ce9-0600-43be-94aa-038eb1edaf07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=f98c5145-23fc-4228-bf00-2a399bb280f0,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98c5145-23') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG os_vif [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=f98c5145-23fc-4228-bf00-2a399bb280f0,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98c5145-23') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf98c5145-23, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf98c5145-23, col_values=(('external_ids', {'iface-id': 'f98c5145-23fc-4228-bf00-2a399bb280f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:3c:6d', 'vm-uuid': 'da287ce9-0600-43be-94aa-038eb1edaf07'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:00:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:34 user nova-compute[73007]: INFO os_vif [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=f98c5145-23fc-4228-bf00-2a399bb280f0,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98c5145-23')
Aug 15 18:00:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:00:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No VIF found with MAC fa:16:3e:9e:3c:6d, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:00:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e9549a5-06bc-4048-a6fb-145dda5998bd req-6e3414a9-d12d-4a8c-b1b8-b18fa400a6cc service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updated VIF entry in instance network info cache for port f98c5145-23fc-4228-bf00-2a399bb280f0. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:00:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e9549a5-06bc-4048-a6fb-145dda5998bd req-6e3414a9-d12d-4a8c-b1b8-b18fa400a6cc service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:00:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e9549a5-06bc-4048-a6fb-145dda5998bd req-6e3414a9-d12d-4a8c-b1b8-b18fa400a6cc service nova] Releasing lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-1749e9a1-0b05-4660-a333-96b8def3a494 req-918abd0f-73b3-437b-9f1c-fc33f240deaa service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1749e9a1-0b05-4660-a333-96b8def3a494 req-918abd0f-73b3-437b-9f1c-fc33f240deaa service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1749e9a1-0b05-4660-a333-96b8def3a494 req-918abd0f-73b3-437b-9f1c-fc33f240deaa service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1749e9a1-0b05-4660-a333-96b8def3a494 req-918abd0f-73b3-437b-9f1c-fc33f240deaa service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-1749e9a1-0b05-4660-a333-96b8def3a494 req-918abd0f-73b3-437b-9f1c-fc33f240deaa service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:00:36 user nova-compute[73007]: WARNING nova.compute.manager [req-1749e9a1-0b05-4660-a333-96b8def3a494 req-918abd0f-73b3-437b-9f1c-fc33f240deaa service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state building and task_state spawning.
Aug 15 18:00:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122438.6943214, da287ce9-0600-43be-94aa-038eb1edaf07 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:00:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] VM Resumed (Lifecycle Event)
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:00:38 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance spawned successfully.
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122438.695999, da287ce9-0600-43be-94aa-038eb1edaf07 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:00:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] VM Started (Lifecycle Event)
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:00:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-97032067-7bcc-444b-bf7d-bd9a858029a2 req-c22006cb-7382-4815-8b8e-c28b068d409c service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-97032067-7bcc-444b-bf7d-bd9a858029a2 req-c22006cb-7382-4815-8b8e-c28b068d409c service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-97032067-7bcc-444b-bf7d-bd9a858029a2 req-c22006cb-7382-4815-8b8e-c28b068d409c service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-97032067-7bcc-444b-bf7d-bd9a858029a2 req-c22006cb-7382-4815-8b8e-c28b068d409c service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-97032067-7bcc-444b-bf7d-bd9a858029a2 req-c22006cb-7382-4815-8b8e-c28b068d409c service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:00:38 user nova-compute[73007]: WARNING nova.compute.manager [req-97032067-7bcc-444b-bf7d-bd9a858029a2 req-c22006cb-7382-4815-8b8e-c28b068d409c service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state building and task_state spawning.
Aug 15 18:00:38 user nova-compute[73007]: INFO nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 15 18:00:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:38 user nova-compute[73007]: INFO nova.compute.manager [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Took 7.34 seconds to build instance.
Aug 15 18:00:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c25dbe17-8416-4204-9de6-ac0ed10a9900 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.445s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:00:46 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Creating image(s)
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Ensure instance console log exists: /opt/stack/data/nova/instances/262a67eb-42f3-4c9f-841b-29096e5b6b0b/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Start _get_guest_xml network_info=[{"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtHngFJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '262a67eb-42f3-4c9f-841b-29096e5b6b0b', 'attached_at': '', 'detached_at': '', 'volume_id': '2681b1cb-b2a5-412b-b8bc-e631cb3b537b', 'serial': '2681b1cb-b2a5-412b-b8bc-e631cb3b537b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '78dd1617-bdea-4883-8153-b3c602a225cd', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:00:46 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:00:46 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtHngFJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:00:46 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:00:46 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:00:46 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faea34e-d038-499a-b9a8-8f317d01c7ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:00:46 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f043e12-644f-49a6-baf4-086c0912537d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b] added
Aug 15 18:00:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[30889776-24ca-4654-bc70-b5a1475d83b7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78fa49f-e6bf-41de-98e2-1bf06e2755f1]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtHngFJw {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtHngFJw" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4aed01-95ee-4006-8951-a43f45b44bed]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PtHngFJw'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c732c5b8-0215-49b8-8f25-b4de4264e67f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b41225-ce63-468d-98b7-492864189a2f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:00:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:00:46 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:00:46 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e8637-38d6-47be-8c5b-c07e3cb3736c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260]
Aug 15 18:00:47 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260] successful.
Aug 15 18:00:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b002874-eea9-4c1f-98fd-f2668da23d2e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85cca05-169f-4c20-95ad-000b04bd431a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:00:47 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:00:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:00:47 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:00:47 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de70f584-e6e2-42b7-84d4-4d0f8120fe88]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG nova.objects.instance [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122432.8524687, 91cffe2e-5666-471f-a45f-1c14ea6668dd => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:00:47 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] VM Stopped (Lifecycle Event)
Aug 15 18:00:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-26e7a9f4-fe83-4ad3-bdf2-808aedf4e04f None None] [instance: 91cffe2e-5666-471f-a45f-1c14ea6668dd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:47 user nova-compute[73007]: INFO nova.compute.manager [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attaching volume 001f2825-bd1f-41dd-b37c-72f609c3b4ab to /dev/vdb
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.utils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a680389e-1680-4cf1-a05c-8be36a2239b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7480a8d0-e071-4af7-9b86-4949a678bd91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[38760211-6996-4d43-86eb-0a942f2c5b11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eca9e4-f0d5-4d76-b37c-abcec00354af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtHngFJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26130663632613865', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130663632613865', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:00:48 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:00:48 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf49b41-4752-413c-b308-b0fd1b8696c4]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_brick.utils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating existing volume attachment record: e8b44f44-b613-4087-b483-f57deb607650 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1522747174',display_name='tempest-TestVolumeBootPattern-server-1522747174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1522747174',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-ahv0ijms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:00:24Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=262a67eb-42f3-4c9f-841b-29096e5b6b0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e7:30,bridge_name='br-int',has_traffic_filtering=True,id=c032d20a-c59f-4c6c-8377-01ca95aa4c4a,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc032d20a-c5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'pci_devices' on Instance uuid 262a67eb-42f3-4c9f-841b-29096e5b6b0b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:00:48 user nova-compute[73007]:   <uuid>262a67eb-42f3-4c9f-841b-29096e5b6b0b</uuid>
Aug 15 18:00:48 user nova-compute[73007]:   <name>instance-00000026</name>
Aug 15 18:00:48 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:00:48 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:00:48 user nova-compute[73007]:   <metadata>
Aug 15 18:00:48 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:00:48 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:00:48 user nova-compute[73007]:       <nova:name>tempest-TestVolumeBootPattern-server-1522747174</nova:name>
Aug 15 18:00:48 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:00:46</nova:creationTime>
Aug 15 18:00:48 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:00:48 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:00:48 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:00:48 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:00:48 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:00:48 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:00:48 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:00:48 user nova-compute[73007]:       <nova:owner>
Aug 15 18:00:48 user nova-compute[73007]:         <nova:user uuid="4cd910b3e8bf406f8512b3470f6eaca5">tempest-TestVolumeBootPattern-393609756-project-member</nova:user>
Aug 15 18:00:48 user nova-compute[73007]:         <nova:project uuid="c6eebca3ef0a45788b0dfbc03b01fe8c">tempest-TestVolumeBootPattern-393609756</nova:project>
Aug 15 18:00:48 user nova-compute[73007]:       </nova:owner>
Aug 15 18:00:48 user nova-compute[73007]:       <nova:ports>
Aug 15 18:00:48 user nova-compute[73007]:         <nova:port uuid="c032d20a-c59f-4c6c-8377-01ca95aa4c4a">
Aug 15 18:00:48 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 18:00:48 user nova-compute[73007]:         </nova:port>
Aug 15 18:00:48 user nova-compute[73007]:       </nova:ports>
Aug 15 18:00:48 user nova-compute[73007]:     </nova:instance>
Aug 15 18:00:48 user nova-compute[73007]:   </metadata>
Aug 15 18:00:48 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:00:48 user nova-compute[73007]:     <system>
Aug 15 18:00:48 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:00:48 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:00:48 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:00:48 user nova-compute[73007]:       <entry name="serial">262a67eb-42f3-4c9f-841b-29096e5b6b0b</entry>
Aug 15 18:00:48 user nova-compute[73007]:       <entry name="uuid">262a67eb-42f3-4c9f-841b-29096e5b6b0b</entry>
Aug 15 18:00:48 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:00:48 user nova-compute[73007]:     </system>
Aug 15 18:00:48 user nova-compute[73007]:   </sysinfo>
Aug 15 18:00:48 user nova-compute[73007]:   <os>
Aug 15 18:00:48 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:00:48 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:00:48 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:00:48 user nova-compute[73007]:   </os>
Aug 15 18:00:48 user nova-compute[73007]:   <features>
Aug 15 18:00:48 user nova-compute[73007]:     <acpi/>
Aug 15 18:00:48 user nova-compute[73007]:     <apic/>
Aug 15 18:00:48 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:00:48 user nova-compute[73007]:   </features>
Aug 15 18:00:48 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:00:48 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:00:48 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:00:48 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:00:48 user nova-compute[73007]:   </clock>
Aug 15 18:00:48 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:00:48 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:00:48 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:00:48 user nova-compute[73007]:   </cpu>
Aug 15 18:00:48 user nova-compute[73007]:   <devices>
Aug 15 18:00:48 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:00:48 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:00:48 user nova-compute[73007]:       <source dev="/dev/sdb"/>
Aug 15 18:00:48 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:00:48 user nova-compute[73007]:       <serial>2681b1cb-b2a5-412b-b8bc-e631cb3b537b</serial>
Aug 15 18:00:48 user nova-compute[73007]:     </disk>
Aug 15 18:00:48 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:00:48 user nova-compute[73007]:       <mac address="fa:16:3e:1b:e7:30"/>
Aug 15 18:00:48 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:00:48 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:00:48 user nova-compute[73007]:       <target dev="tapc032d20a-c5"/>
Aug 15 18:00:48 user nova-compute[73007]:     </interface>
Aug 15 18:00:48 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:00:48 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/262a67eb-42f3-4c9f-841b-29096e5b6b0b/console.log" append="off"/>
Aug 15 18:00:48 user nova-compute[73007]:     </serial>
Aug 15 18:00:48 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:00:48 user nova-compute[73007]:     <video>
Aug 15 18:00:48 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:00:48 user nova-compute[73007]:     </video>
Aug 15 18:00:48 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:00:48 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:00:48 user nova-compute[73007]:     </rng>
Aug 15 18:00:48 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:00:48 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:00:48 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:00:48 user nova-compute[73007]:     </memballoon>
Aug 15 18:00:48 user nova-compute[73007]:   </devices>
Aug 15 18:00:48 user nova-compute[73007]: </domain>
Aug 15 18:00:48 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1522747174',display_name='tempest-TestVolumeBootPattern-server-1522747174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1522747174',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-ahv0ijms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:00:24Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=262a67eb-42f3-4c9f-841b-29096e5b6b0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e7:30,bridge_name='br-int',has_traffic_filtering=True,id=c032d20a-c59f-4c6c-8377-01ca95aa4c4a,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc032d20a-c5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG os_vif [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e7:30,bridge_name='br-int',has_traffic_filtering=True,id=c032d20a-c59f-4c6c-8377-01ca95aa4c4a,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc032d20a-c5') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc032d20a-c5, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc032d20a-c5, col_values=(('external_ids', {'iface-id': 'c032d20a-c59f-4c6c-8377-01ca95aa4c4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:e7:30', 'vm-uuid': '262a67eb-42f3-4c9f-841b-29096e5b6b0b'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:48 user nova-compute[73007]: INFO os_vif [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e7:30,bridge_name='br-int',has_traffic_filtering=True,id=c032d20a-c59f-4c6c-8377-01ca95aa4c4a,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc032d20a-c5')
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:00:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No VIF found with MAC fa:16:3e:1b:e7:30, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:00:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-4481934b-9446-46bb-a992-8c254a23b9dc req-1146fadc-a9e9-450c-ab50-b3fa35a1696e service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4481934b-9446-46bb-a992-8c254a23b9dc req-1146fadc-a9e9-450c-ab50-b3fa35a1696e service nova] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4481934b-9446-46bb-a992-8c254a23b9dc req-1146fadc-a9e9-450c-ab50-b3fa35a1696e service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4481934b-9446-46bb-a992-8c254a23b9dc req-1146fadc-a9e9-450c-ab50-b3fa35a1696e service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-4481934b-9446-46bb-a992-8c254a23b9dc req-1146fadc-a9e9-450c-ab50-b3fa35a1696e service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] No waiting events found dispatching network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:00:50 user nova-compute[73007]: WARNING nova.compute.manager [req-4481934b-9446-46bb-a992-8c254a23b9dc req-1146fadc-a9e9-450c-ab50-b3fa35a1696e service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received unexpected event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a for instance with vm_state building and task_state spawning.
Aug 15 18:00:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:51 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122451.9937296, 262a67eb-42f3-4c9f-841b-29096e5b6b0b => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:00:51 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] VM Resumed (Lifecycle Event)
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:00:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Instance spawned successfully.
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:00:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122451.9989243, 262a67eb-42f3-4c9f-841b-29096e5b6b0b => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:00:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] VM Started (Lifecycle Event)
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-c8e928ea-a2b1-4a4d-bc09-3d91e4b720cd req-ecfc75bd-3332-4016-b470-f204e1117f4d service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c8e928ea-a2b1-4a4d-bc09-3d91e4b720cd req-ecfc75bd-3332-4016-b470-f204e1117f4d service nova] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c8e928ea-a2b1-4a4d-bc09-3d91e4b720cd req-ecfc75bd-3332-4016-b470-f204e1117f4d service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c8e928ea-a2b1-4a4d-bc09-3d91e4b720cd req-ecfc75bd-3332-4016-b470-f204e1117f4d service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-c8e928ea-a2b1-4a4d-bc09-3d91e4b720cd req-ecfc75bd-3332-4016-b470-f204e1117f4d service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] No waiting events found dispatching network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:00:52 user nova-compute[73007]: WARNING nova.compute.manager [req-c8e928ea-a2b1-4a4d-bc09-3d91e4b720cd req-ecfc75bd-3332-4016-b470-f204e1117f4d service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received unexpected event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a for instance with vm_state building and task_state spawning.
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:00:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:00:52 user nova-compute[73007]: INFO nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Took 5.37 seconds to spawn the instance on the hypervisor.
Aug 15 18:00:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:00:52 user nova-compute[73007]: INFO nova.compute.manager [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Took 28.73 seconds to build instance.
Aug 15 18:00:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e5a7065-1408-4762-8567-2a49e07e5385 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.828s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:00:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:00:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLMuCRik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:01:06 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:01:06 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:01:06 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cc82c3-7507-4525-aa01-2d16ad39857e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:01:06 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf607a7a-28ec-487d-81f1-f3b6948e7c7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab] added
Aug 15 18:01:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e38f0fe-d91c-41eb-a6ab-3d33c98ff2da]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ee711e-384e-4747-896c-87f29fd012c9]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLMuCRik {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLMuCRik" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccdfa6e-c8e9-4588-97aa-0200a9c61a0e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cLMuCRik'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8c4a2-65bb-4552-8564-5d543edfcc47]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1540ab08-25bd-4438-94cd-0fff8b2e10fc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:06 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:06 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab61ccb-ca2a-4f51-9e56-0ef7b3ede111]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab, portal: 172.16.0.220,3260]
Aug 15 18:01:06 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab, portal: 172.16.0.220,3260] successful.
Aug 15 18:01:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b6d3c3-acfd-4e2e-8d56-d171f3a3cee4]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aadc74-d64f-4375-8ffb-09ea78be1709]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:06 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:06 user nova-compute[73007]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab (non-flash)
Aug 15 18:01:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:06 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:06 user nova-compute[73007]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab (non-flash)
Aug 15 18:01:06 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f4f334-03da-4d77-b44d-0a5b2d05dc96]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:01:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLMuCRik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:01:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:01:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26337343161363734', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:01:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337343161363734', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:01:07 user nova-compute[73007]: DEBUG nova.objects.instance [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:01:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:01:07 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:01:07 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 18:01:07 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:01:07 user nova-compute[73007]:   <serial>001f2825-bd1f-41dd-b37c-72f609c3b4ab</serial>
Aug 15 18:01:07 user nova-compute[73007]: </disk>
Aug 15 18:01:07 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:01:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:01:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:01:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No VIF found with MAC fa:16:3e:6b:92:1b, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-890bff71-6a80-49d6-9d92-ecdb7901275b tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.099s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:01:08 user nova-compute[73007]: INFO nova.compute.claims [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Claim successful on node user
Aug 15 18:01:08 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:01:08 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:01:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:01:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:01:09 user nova-compute[73007]: INFO nova.virt.block_device [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Booting with volume-backed-image ebea4084-739d-4b93-af7c-d6ebe6897cd3 at /dev/vda
Aug 15 18:01:09 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG nova.policy [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b7b5264253d44e9a51d06f66bed1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e88231a35bb4a2e8b5e1e7d5e5f9418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:01:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Updating instance_info_cache with network_info: [{"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-d9648621-6b91-4028-9f89-83302bc7a8cd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Successfully created port: 1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:10 user nova-compute[73007]: INFO nova.compute.manager [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Detaching volume 001f2825-bd1f-41dd-b37c-72f609c3b4ab
Aug 15 18:01:10 user nova-compute[73007]: INFO nova.virt.block_device [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attempting to driver detach volume 001f2825-bd1f-41dd-b37c-72f609c3b4ab from mountpoint /dev/vdb
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Attempting to detach device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:01:10 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:01:10 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 18:01:10 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:01:10 user nova-compute[73007]:   <serial>001f2825-bd1f-41dd-b37c-72f609c3b4ab</serial>
Aug 15 18:01:10 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:01:10 user nova-compute[73007]: </disk>
Aug 15 18:01:10 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:01:10 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully detached device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the persistent domain config.
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:01:10 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:01:10 user nova-compute[73007]:   <source dev="/dev/sdd"/>
Aug 15 18:01:10 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:01:10 user nova-compute[73007]:   <serial>001f2825-bd1f-41dd-b37c-72f609c3b4ab</serial>
Aug 15 18:01:10 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:01:10 user nova-compute[73007]: </disk>
Aug 15 18:01:10 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122470.9652267, 029c5519-9937-439c-9fc7-f1bad76d26f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:01:10 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully detached device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the live domain config.
Aug 15 18:01:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLMuCRik', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:01:10 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:01:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:01:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d089cb0-6bea-4b23-9014-c23c97d7bdab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b399df-5339-4010-be5b-5435ccdf58f8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:11 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:11 user nova-compute[73007]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab (non-flash)
Aug 15 18:01:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:11 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:11 user nova-compute[73007]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab (non-flash)
Aug 15 18:01:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c417b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8b4dfd-362f-447b-b990-858975741b87]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[52854c19-ff34-4278-bbac-a7451a9cd19d]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[df49588e-f3d9-4c29-b533-b888928c5ae0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[411c0d92-d59c-455a-89de-56a69ffca901]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69e663d-adc0-4dc2-a964-e8fc0f73265b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad870f-2bbf-4811-894a-24921eb23c1f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab, portal: 172.16.0.220,3260]
Aug 15 18:01:11 user nova-compute[73007]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab, portal: 172.16.0.220,3260] successful.
Aug 15 18:01:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:001f2825-bd1f-41dd-b37c-72f609c3b4ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f133f59a-0376-440f-8d15-72e9043ab85e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== disconnect_volume: return (315ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Successfully updated port: 1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquired lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-256b5cda-0efa-4f8a-adc8-0c4423268f5a req-c65e6267-e021-4aea-95cf-4f9619834fe4 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-changed-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-256b5cda-0efa-4f8a-adc8-0c4423268f5a req-c65e6267-e021-4aea-95cf-4f9619834fe4 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Refreshing instance network info cache due to event network-changed-1f852c51-0895-4cf3-8fd9-a5b266f8166b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-256b5cda-0efa-4f8a-adc8-0c4423268f5a req-c65e6267-e021-4aea-95cf-4f9619834fe4 service nova] Acquiring lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Updating instance_info_cache with network_info: [{"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Releasing lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance network_info: |[{"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-256b5cda-0efa-4f8a-adc8-0c4423268f5a req-c65e6267-e021-4aea-95cf-4f9619834fe4 service nova] Acquired lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:01:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-256b5cda-0efa-4f8a-adc8-0c4423268f5a req-c65e6267-e021-4aea-95cf-4f9619834fe4 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Refreshing network info cache for port 1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:01:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:01:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3e757ae0-7584-4fac-a40a-ed161c676d50 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.848s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-256b5cda-0efa-4f8a-adc8-0c4423268f5a req-c65e6267-e021-4aea-95cf-4f9619834fe4 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Updated VIF entry in instance network info cache for port 1f852c51-0895-4cf3-8fd9-a5b266f8166b. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:01:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-256b5cda-0efa-4f8a-adc8-0c4423268f5a req-c65e6267-e021-4aea-95cf-4f9619834fe4 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Updating instance_info_cache with network_info: [{"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:01:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-256b5cda-0efa-4f8a-adc8-0c4423268f5a req-c65e6267-e021-4aea-95cf-4f9619834fe4 service nova] Releasing lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:17 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:01:17 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7421MB free_disk=25.10430908203125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 029c5519-9937-439c-9fc7-f1bad76d26f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 262a67eb-42f3-4c9f-841b-29096e5b6b0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance da287ce9-0600-43be-94aa-038eb1edaf07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5d29f229-4024-4a0e-b18a-b7a79de8c583 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:01:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG os_brick.utils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e62280f-e550-4cba-8f84-e94bf17698b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8b0b71-129e-4738-8493-140b89f2d687]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fbb342-e0da-4f92-98d8-f331f36d219d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4432932-06e2-4e28-ad37-fc6ea630180c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:01:20 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:01:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86fac83-f590-491f-a811-01d2687f8487]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG os_brick.utils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:01:20 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Updating existing volume attachment record: 48635181-8da1-4068-b0b8-000115d4e0af {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:01:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:01:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:01:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:01:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:01:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:01:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:01:34 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Creating image(s)
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Ensure instance console log exists: /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Start _get_guest_xml network_info=[{"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtzdoGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d29f229-4024-4a0e-b18a-b7a79de8c583', 'attached_at': '', 'detached_at': '', 'volume_id': '0ce6b5aa-d6f5-4618-915c-3a87ba972f5b', 'serial': '0ce6b5aa-d6f5-4618-915c-3a87ba972f5b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '48635181-8da1-4068-b0b8-000115d4e0af', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:01:34 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:01:34 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:01:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtzdoGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:01:35 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:01:35 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:01:35 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[19399879-0327-4485-974f-d21372935d57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:01:35 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef903f41-2f3c-4858-9b70-395ef363d716]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b] added
Aug 15 18:01:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f695ea3d-6a45-4b4f-9bf4-87ae9d6c4dd0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[85763060-8021-440a-87db-1555106914cf]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtzdoGHi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtzdoGHi" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c01ce44-2a45-4e3a-8705-792bf15747fe]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WtzdoGHi'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[284acfca-6aa3-476b-aab2-afd12d331994]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c958ddf3-2e8b-42a8-8448-752177e433ae]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:35 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:35 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6098cc7-131e-4006-9c99-c1c499835e51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b, portal: 172.16.0.220,3260]
Aug 15 18:01:35 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b, portal: 172.16.0.220,3260] successful.
Aug 15 18:01:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[defd73a1-df09-46e6-a199-0dd6a3659542]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc7dee-2198-4fe2-83ee-974cbf199c53]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:35 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:35 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:01:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:01:35 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:01:35 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:01:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bfc4c8-dca1-48d8-88fe-4ae58509eb63]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:01:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtzdoGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23866326431346530', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866326431346530', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-329861494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-329861494',id=40,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-tw4g3u07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:01:09Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=5d29f229-4024-4a0e-b18a-b7a79de8c583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=1f852c51-0895-4cf3-8fd9-a5b266f8166b,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f852c51-08') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:01:36 user nova-compute[73007]:   <uuid>5d29f229-4024-4a0e-b18a-b7a79de8c583</uuid>
Aug 15 18:01:36 user nova-compute[73007]:   <name>instance-00000028</name>
Aug 15 18:01:36 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:01:36 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:01:36 user nova-compute[73007]:   <metadata>
Aug 15 18:01:36 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:01:36 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:01:36 user nova-compute[73007]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-329861494</nova:name>
Aug 15 18:01:36 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:01:34</nova:creationTime>
Aug 15 18:01:36 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:01:36 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:01:36 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:01:36 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:01:36 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:01:36 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:01:36 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:01:36 user nova-compute[73007]:       <nova:owner>
Aug 15 18:01:36 user nova-compute[73007]:         <nova:user uuid="2b7b5264253d44e9a51d06f66bed1443">tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member</nova:user>
Aug 15 18:01:36 user nova-compute[73007]:         <nova:project uuid="6e88231a35bb4a2e8b5e1e7d5e5f9418">tempest-ServerBootFromVolumeStableRescueTest-452961283</nova:project>
Aug 15 18:01:36 user nova-compute[73007]:       </nova:owner>
Aug 15 18:01:36 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:01:36 user nova-compute[73007]:       <nova:ports>
Aug 15 18:01:36 user nova-compute[73007]:         <nova:port uuid="1f852c51-0895-4cf3-8fd9-a5b266f8166b">
Aug 15 18:01:36 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 18:01:36 user nova-compute[73007]:         </nova:port>
Aug 15 18:01:36 user nova-compute[73007]:       </nova:ports>
Aug 15 18:01:36 user nova-compute[73007]:     </nova:instance>
Aug 15 18:01:36 user nova-compute[73007]:   </metadata>
Aug 15 18:01:36 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:01:36 user nova-compute[73007]:     <system>
Aug 15 18:01:36 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:01:36 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:01:36 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:01:36 user nova-compute[73007]:       <entry name="serial">5d29f229-4024-4a0e-b18a-b7a79de8c583</entry>
Aug 15 18:01:36 user nova-compute[73007]:       <entry name="uuid">5d29f229-4024-4a0e-b18a-b7a79de8c583</entry>
Aug 15 18:01:36 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:01:36 user nova-compute[73007]:     </system>
Aug 15 18:01:36 user nova-compute[73007]:   </sysinfo>
Aug 15 18:01:36 user nova-compute[73007]:   <os>
Aug 15 18:01:36 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:01:36 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:01:36 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:01:36 user nova-compute[73007]:   </os>
Aug 15 18:01:36 user nova-compute[73007]:   <features>
Aug 15 18:01:36 user nova-compute[73007]:     <acpi/>
Aug 15 18:01:36 user nova-compute[73007]:     <apic/>
Aug 15 18:01:36 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:01:36 user nova-compute[73007]:   </features>
Aug 15 18:01:36 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:01:36 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:01:36 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:01:36 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:01:36 user nova-compute[73007]:   </clock>
Aug 15 18:01:36 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:01:36 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:01:36 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:01:36 user nova-compute[73007]:   </cpu>
Aug 15 18:01:36 user nova-compute[73007]:   <devices>
Aug 15 18:01:36 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:01:36 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:01:36 user nova-compute[73007]:       <source dev="/dev/sdd"/>
Aug 15 18:01:36 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:01:36 user nova-compute[73007]:       <serial>0ce6b5aa-d6f5-4618-915c-3a87ba972f5b</serial>
Aug 15 18:01:36 user nova-compute[73007]:     </disk>
Aug 15 18:01:36 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:01:36 user nova-compute[73007]:       <mac address="fa:16:3e:8f:a4:96"/>
Aug 15 18:01:36 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:01:36 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:01:36 user nova-compute[73007]:       <target dev="tap1f852c51-08"/>
Aug 15 18:01:36 user nova-compute[73007]:     </interface>
Aug 15 18:01:36 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:01:36 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/console.log" append="off"/>
Aug 15 18:01:36 user nova-compute[73007]:     </serial>
Aug 15 18:01:36 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:01:36 user nova-compute[73007]:     <video>
Aug 15 18:01:36 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:01:36 user nova-compute[73007]:     </video>
Aug 15 18:01:36 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:01:36 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:01:36 user nova-compute[73007]:     </rng>
Aug 15 18:01:36 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:01:36 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:01:36 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:01:36 user nova-compute[73007]:     </memballoon>
Aug 15 18:01:36 user nova-compute[73007]:   </devices>
Aug 15 18:01:36 user nova-compute[73007]: </domain>
Aug 15 18:01:36 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-329861494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-329861494',id=40,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-tw4g3u07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:01:09Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=5d29f229-4024-4a0e-b18a-b7a79de8c583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=1f852c51-0895-4cf3-8fd9-a5b266f8166b,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f852c51-08') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG os_vif [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=1f852c51-0895-4cf3-8fd9-a5b266f8166b,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f852c51-08') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f852c51-08, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f852c51-08, col_values=(('external_ids', {'iface-id': '1f852c51-0895-4cf3-8fd9-a5b266f8166b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:a4:96', 'vm-uuid': '5d29f229-4024-4a0e-b18a-b7a79de8c583'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:36 user nova-compute[73007]: INFO os_vif [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=1f852c51-0895-4cf3-8fd9-a5b266f8166b,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f852c51-08')
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:01:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No VIF found with MAC fa:16:3e:8f:a4:96, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:01:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-5b7107f0-b4e8-4b54-ae0a-ab2d8fe24fcc req-35f97ecb-62da-4703-9d74-54467bd98feb service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:01:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5b7107f0-b4e8-4b54-ae0a-ab2d8fe24fcc req-35f97ecb-62da-4703-9d74-54467bd98feb service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5b7107f0-b4e8-4b54-ae0a-ab2d8fe24fcc req-35f97ecb-62da-4703-9d74-54467bd98feb service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5b7107f0-b4e8-4b54-ae0a-ab2d8fe24fcc req-35f97ecb-62da-4703-9d74-54467bd98feb service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-5b7107f0-b4e8-4b54-ae0a-ab2d8fe24fcc req-35f97ecb-62da-4703-9d74-54467bd98feb service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:01:38 user nova-compute[73007]: WARNING nova.compute.manager [req-5b7107f0-b4e8-4b54-ae0a-ab2d8fe24fcc req-35f97ecb-62da-4703-9d74-54467bd98feb service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state building and task_state spawning.
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122499.8776293, 5d29f229-4024-4a0e-b18a-b7a79de8c583 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:01:39 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] VM Resumed (Lifecycle Event)
Aug 15 18:01:39 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance spawned successfully.
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:39 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122499.878234, 5d29f229-4024-4a0e-b18a-b7a79de8c583 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:01:39 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] VM Started (Lifecycle Event)
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:01:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:01:40 user nova-compute[73007]: INFO nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Took 5.07 seconds to spawn the instance on the hypervisor.
Aug 15 18:01:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:01:40 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:01:40 user nova-compute[73007]: INFO nova.compute.manager [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Took 31.69 seconds to build instance.
Aug 15 18:01:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8cadb05-b735-4b4b-8bdd-24c7c0fab4e0 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.803s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-242a3c9e-12a1-498a-b4f7-bbb68bb03f1c req-a44684d3-030e-44e2-a9d6-f7abf192f3ed service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:01:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-242a3c9e-12a1-498a-b4f7-bbb68bb03f1c req-a44684d3-030e-44e2-a9d6-f7abf192f3ed service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-242a3c9e-12a1-498a-b4f7-bbb68bb03f1c req-a44684d3-030e-44e2-a9d6-f7abf192f3ed service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-242a3c9e-12a1-498a-b4f7-bbb68bb03f1c req-a44684d3-030e-44e2-a9d6-f7abf192f3ed service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-242a3c9e-12a1-498a-b4f7-bbb68bb03f1c req-a44684d3-030e-44e2-a9d6-f7abf192f3ed service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:01:40 user nova-compute[73007]: WARNING nova.compute.manager [req-242a3c9e-12a1-498a-b4f7-bbb68bb03f1c req-a44684d3-030e-44e2-a9d6-f7abf192f3ed service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state active and task_state None.
Aug 15 18:01:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:01:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:01:45 user nova-compute[73007]: INFO nova.compute.claims [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Claim successful on node user
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.network.neutron [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:01:46 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.policy [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60ec8200260d42b7bdb788b3f745eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06843dd305d24f79b1aa4f4772322248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:01:46 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Creating image(s)
Aug 15 18:01:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "/opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "/opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "/opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "94b598af4d575bd5d1160f19ba8f0b8552199cdb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "94b598af4d575bd5d1160f19ba8f0b8552199cdb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb.part --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG nova.virt.images [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] 53b95b3d-55cc-4553-a1d3-d3cce54355b7 was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb.part /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG nova.network.neutron [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Successfully created port: 6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb.part /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb.converted" returned: 0 in 0.384s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "94b598af4d575bd5d1160f19ba8f0b8552199cdb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.479s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:47 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "94b598af4d575bd5d1160f19ba8f0b8552199cdb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "94b598af4d575bd5d1160f19ba8f0b8552199cdb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb,backing_fmt=raw /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb,backing_fmt=raw /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk 1073741824" returned: 0 in 0.062s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "94b598af4d575bd5d1160f19ba8f0b8552199cdb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.network.neutron [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Successfully updated port: 6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquired lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.network.neutron [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-8b64365a-3f53-4567-8097-d2aa26f6ce78 req-7a35026e-10f7-4a8e-9a35-940880defe4a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-8b64365a-3f53-4567-8097-d2aa26f6ce78 req-7a35026e-10f7-4a8e-9a35-940880defe4a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing instance network info cache due to event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8b64365a-3f53-4567-8097-d2aa26f6ce78 req-7a35026e-10f7-4a8e-9a35-940880defe4a service nova] Acquiring lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.network.neutron [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Cannot resize image /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.objects.instance [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'migration_context' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Ensure instance console log exists: /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.network.neutron [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating instance_info_cache with network_info: [{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Releasing lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Instance network_info: |[{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8b64365a-3f53-4567-8097-d2aa26f6ce78 req-7a35026e-10f7-4a8e-9a35-940880defe4a service nova] Acquired lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.network.neutron [req-8b64365a-3f53-4567-8097-d2aa26f6ce78 req-7a35026e-10f7-4a8e-9a35-940880defe4a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Start _get_guest_xml network_info=[{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T18:01:42Z,direct_url=<?>,disk_format='qcow2',id=53b95b3d-55cc-4553-a1d3-d3cce54355b7,min_disk=0,min_ram=0,name='tempest-scenario-img--746109487',owner='06843dd305d24f79b1aa4f4772322248',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T18:01:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '53b95b3d-55cc-4553-a1d3-d3cce54355b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:01:48 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:01:48 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T18:01:42Z,direct_url=<?>,disk_format='qcow2',id=53b95b3d-55cc-4553-a1d3-d3cce54355b7,min_disk=0,min_ram=0,name='tempest-scenario-img--746109487',owner='06843dd305d24f79b1aa4f4772322248',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T18:01:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1652858877',display_name='tempest-TestMinimumBasicScenario-server-1652858877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1652858877',id=41,image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgeUvRRpeWnwuUO8i59hmKKurHKDuyNddeJ5d2vXN4gN93Z9y7tetWok1QrY1pdDvYXaPQGwx9njGawQmiov6dk+UAW7t4DM9brzrIwaaT480dRSg3LiePVo60gQc/yNg==',key_name='tempest-TestMinimumBasicScenario-1607872540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-tw49lt7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:01:46Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=6545b6a7-4c0e-4d97-8c98-7491292c566a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:01:48 user nova-compute[73007]: DEBUG nova.objects.instance [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'pci_devices' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:01:49 user nova-compute[73007]:   <uuid>6545b6a7-4c0e-4d97-8c98-7491292c566a</uuid>
Aug 15 18:01:49 user nova-compute[73007]:   <name>instance-00000029</name>
Aug 15 18:01:49 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:01:49 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:01:49 user nova-compute[73007]:   <metadata>
Aug 15 18:01:49 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:01:49 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:01:49 user nova-compute[73007]:       <nova:name>tempest-TestMinimumBasicScenario-server-1652858877</nova:name>
Aug 15 18:01:49 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:01:48</nova:creationTime>
Aug 15 18:01:49 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:01:49 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:01:49 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:01:49 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:01:49 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:01:49 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:01:49 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:01:49 user nova-compute[73007]:       <nova:owner>
Aug 15 18:01:49 user nova-compute[73007]:         <nova:user uuid="60ec8200260d42b7bdb788b3f745eb84">tempest-TestMinimumBasicScenario-1021033428-project-member</nova:user>
Aug 15 18:01:49 user nova-compute[73007]:         <nova:project uuid="06843dd305d24f79b1aa4f4772322248">tempest-TestMinimumBasicScenario-1021033428</nova:project>
Aug 15 18:01:49 user nova-compute[73007]:       </nova:owner>
Aug 15 18:01:49 user nova-compute[73007]:       <nova:root type="image" uuid="53b95b3d-55cc-4553-a1d3-d3cce54355b7"/>
Aug 15 18:01:49 user nova-compute[73007]:       <nova:ports>
Aug 15 18:01:49 user nova-compute[73007]:         <nova:port uuid="6120a809-279a-4cb4-b7d7-17da5e39273f">
Aug 15 18:01:49 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 18:01:49 user nova-compute[73007]:         </nova:port>
Aug 15 18:01:49 user nova-compute[73007]:       </nova:ports>
Aug 15 18:01:49 user nova-compute[73007]:     </nova:instance>
Aug 15 18:01:49 user nova-compute[73007]:   </metadata>
Aug 15 18:01:49 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:01:49 user nova-compute[73007]:     <system>
Aug 15 18:01:49 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:01:49 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:01:49 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:01:49 user nova-compute[73007]:       <entry name="serial">6545b6a7-4c0e-4d97-8c98-7491292c566a</entry>
Aug 15 18:01:49 user nova-compute[73007]:       <entry name="uuid">6545b6a7-4c0e-4d97-8c98-7491292c566a</entry>
Aug 15 18:01:49 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:01:49 user nova-compute[73007]:     </system>
Aug 15 18:01:49 user nova-compute[73007]:   </sysinfo>
Aug 15 18:01:49 user nova-compute[73007]:   <os>
Aug 15 18:01:49 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:01:49 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:01:49 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:01:49 user nova-compute[73007]:   </os>
Aug 15 18:01:49 user nova-compute[73007]:   <features>
Aug 15 18:01:49 user nova-compute[73007]:     <acpi/>
Aug 15 18:01:49 user nova-compute[73007]:     <apic/>
Aug 15 18:01:49 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:01:49 user nova-compute[73007]:   </features>
Aug 15 18:01:49 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:01:49 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:01:49 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:01:49 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:01:49 user nova-compute[73007]:   </clock>
Aug 15 18:01:49 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:01:49 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:01:49 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:01:49 user nova-compute[73007]:   </cpu>
Aug 15 18:01:49 user nova-compute[73007]:   <devices>
Aug 15 18:01:49 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:01:49 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:01:49 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk"/>
Aug 15 18:01:49 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:01:49 user nova-compute[73007]:     </disk>
Aug 15 18:01:49 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:01:49 user nova-compute[73007]:       <mac address="fa:16:3e:f0:3a:c8"/>
Aug 15 18:01:49 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:01:49 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:01:49 user nova-compute[73007]:       <target dev="tap6120a809-27"/>
Aug 15 18:01:49 user nova-compute[73007]:     </interface>
Aug 15 18:01:49 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:01:49 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/console.log" append="off"/>
Aug 15 18:01:49 user nova-compute[73007]:     </serial>
Aug 15 18:01:49 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:01:49 user nova-compute[73007]:     <video>
Aug 15 18:01:49 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:01:49 user nova-compute[73007]:     </video>
Aug 15 18:01:49 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:01:49 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:01:49 user nova-compute[73007]:     </rng>
Aug 15 18:01:49 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:01:49 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:01:49 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:01:49 user nova-compute[73007]:     </memballoon>
Aug 15 18:01:49 user nova-compute[73007]:   </devices>
Aug 15 18:01:49 user nova-compute[73007]: </domain>
Aug 15 18:01:49 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1652858877',display_name='tempest-TestMinimumBasicScenario-server-1652858877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1652858877',id=41,image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgeUvRRpeWnwuUO8i59hmKKurHKDuyNddeJ5d2vXN4gN93Z9y7tetWok1QrY1pdDvYXaPQGwx9njGawQmiov6dk+UAW7t4DM9brzrIwaaT480dRSg3LiePVo60gQc/yNg==',key_name='tempest-TestMinimumBasicScenario-1607872540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-tw49lt7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:01:46Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=6545b6a7-4c0e-4d97-8c98-7491292c566a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG os_vif [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6120a809-27, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6120a809-27, col_values=(('external_ids', {'iface-id': '6120a809-279a-4cb4-b7d7-17da5e39273f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:3a:c8', 'vm-uuid': '6545b6a7-4c0e-4d97-8c98-7491292c566a'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:49 user nova-compute[73007]: INFO os_vif [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27')
Aug 15 18:01:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No VIF found with MAC fa:16:3e:f0:3a:c8, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-8b64365a-3f53-4567-8097-d2aa26f6ce78 req-7a35026e-10f7-4a8e-9a35-940880defe4a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updated VIF entry in instance network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG nova.network.neutron [req-8b64365a-3f53-4567-8097-d2aa26f6ce78 req-7a35026e-10f7-4a8e-9a35-940880defe4a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating instance_info_cache with network_info: [{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:01:49 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8b64365a-3f53-4567-8097-d2aa26f6ce78 req-7a35026e-10f7-4a8e-9a35-940880defe4a service nova] Releasing lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:01:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-e9641adc-7830-4ba2-a581-8d6078ad3921 req-67565d27-306e-4072-b65b-169875db9c9f service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:01:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e9641adc-7830-4ba2-a581-8d6078ad3921 req-67565d27-306e-4072-b65b-169875db9c9f service nova] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e9641adc-7830-4ba2-a581-8d6078ad3921 req-67565d27-306e-4072-b65b-169875db9c9f service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e9641adc-7830-4ba2-a581-8d6078ad3921 req-67565d27-306e-4072-b65b-169875db9c9f service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-e9641adc-7830-4ba2-a581-8d6078ad3921 req-67565d27-306e-4072-b65b-169875db9c9f service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] No waiting events found dispatching network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:01:50 user nova-compute[73007]: WARNING nova.compute.manager [req-e9641adc-7830-4ba2-a581-8d6078ad3921 req-67565d27-306e-4072-b65b-169875db9c9f service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received unexpected event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f for instance with vm_state building and task_state spawning.
Aug 15 18:01:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122512.5723383, 6545b6a7-4c0e-4d97-8c98-7491292c566a => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:01:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] VM Resumed (Lifecycle Event)
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:01:52 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Instance spawned successfully.
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:01:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122512.5731785, 6545b6a7-4c0e-4d97-8c98-7491292c566a => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:01:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] VM Started (Lifecycle Event)
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:01:52 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:01:52 user nova-compute[73007]: INFO nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-81219909-b22f-4d6c-aa77-2f2acf5aea5e req-a2d541fa-bfaf-4476-8d4a-5d94b6d7bde4 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81219909-b22f-4d6c-aa77-2f2acf5aea5e req-a2d541fa-bfaf-4476-8d4a-5d94b6d7bde4 service nova] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81219909-b22f-4d6c-aa77-2f2acf5aea5e req-a2d541fa-bfaf-4476-8d4a-5d94b6d7bde4 service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-81219909-b22f-4d6c-aa77-2f2acf5aea5e req-a2d541fa-bfaf-4476-8d4a-5d94b6d7bde4 service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-81219909-b22f-4d6c-aa77-2f2acf5aea5e req-a2d541fa-bfaf-4476-8d4a-5d94b6d7bde4 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] No waiting events found dispatching network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:01:52 user nova-compute[73007]: WARNING nova.compute.manager [req-81219909-b22f-4d6c-aa77-2f2acf5aea5e req-a2d541fa-bfaf-4476-8d4a-5d94b6d7bde4 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received unexpected event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f for instance with vm_state building and task_state spawning.
Aug 15 18:01:52 user nova-compute[73007]: INFO nova.compute.manager [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Took 7.26 seconds to build instance.
Aug 15 18:01:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-959840ba-570e-47d5-aa34-ae694d9f66e9 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.376s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:01:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:01:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-3d8ab5db-5f64-4f95-81a3-dfb532cee20e req-6944b906-b687-4419-8e14-3ed6d451406a service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-changed-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-3d8ab5db-5f64-4f95-81a3-dfb532cee20e req-6944b906-b687-4419-8e14-3ed6d451406a service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Refreshing instance network info cache due to event network-changed-cc02a4b7-09c0-4dee-9f52-7546e80dad26. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:02:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d8ab5db-5f64-4f95-81a3-dfb532cee20e req-6944b906-b687-4419-8e14-3ed6d451406a service nova] Acquiring lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d8ab5db-5f64-4f95-81a3-dfb532cee20e req-6944b906-b687-4419-8e14-3ed6d451406a service nova] Acquired lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:02 user nova-compute[73007]: DEBUG nova.network.neutron [req-3d8ab5db-5f64-4f95-81a3-dfb532cee20e req-6944b906-b687-4419-8e14-3ed6d451406a service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Refreshing network info cache for port cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'flavor' on Instance uuid 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-3d8ab5db-5f64-4f95-81a3-dfb532cee20e req-6944b906-b687-4419-8e14-3ed6d451406a service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updated VIF entry in instance network info cache for port cc02a4b7-09c0-4dee-9f52-7546e80dad26. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-3d8ab5db-5f64-4f95-81a3-dfb532cee20e req-6944b906-b687-4419-8e14-3ed6d451406a service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updating instance_info_cache with network_info: [{"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3d8ab5db-5f64-4f95-81a3-dfb532cee20e req-6944b906-b687-4419-8e14-3ed6d451406a service nova] Releasing lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:03 user nova-compute[73007]: INFO nova.compute.manager [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Attaching volume 2517b212-2eb9-4bba-b26e-b35e1b1a5704 to /dev/vdb
Aug 15 18:02:03 user nova-compute[73007]: DEBUG os_brick.utils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96879fe-2162-4811-9739-48ec40155e2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd4215a-b355-4ea1-aa36-9294cae39fe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07b0ef0-bf41-46c5-9a51-5d1daec0f0a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f23ab5-fc22-4485-a163-f8a1c658db53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:02:03 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:02:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8275c251-30d5-416f-b392-6b50a039e7f5]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG os_brick.utils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:03 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updating existing volume attachment record: b7f518ad-e00d-4c56-a992-5a7fc7267c14 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:02:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:04 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:04 user nova-compute[73007]: INFO nova.compute.manager [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attaching volume 9271916a-06cd-4e27-9cff-7f51bc1a4af1 to /dev/vdb
Aug 15 18:02:05 user nova-compute[73007]: DEBUG os_brick.utils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[353fcca2-4c0f-4259-afaa-2191c60c1aac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b722e2-d77b-41dc-83a4-e3ab262c62c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f042d6bf-20ce-4b17-81f2-7aab1633cf7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebbdf4d-29fb-4d0b-8cc1-dbb6aa0b9fec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:02:05 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:02:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d030430d-38c4-413b-b5a9-0f3f76c475d0]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG os_brick.utils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:05 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating existing volume attachment record: 1dd73a36-73f9-452a-8306-751d286237a1 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:02:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "0678e5e5-d3d8-43f0-937d-e367bd94329a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:02:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:08 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:02:08 user nova-compute[73007]: INFO nova.compute.claims [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Claim successful on node user
Aug 15 18:02:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:02:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:02:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Creating image(s)
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "/opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "/opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "/opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.225s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG nova.policy [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a5e100257194a25b2f284f6192a6217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c9a3513ed8408e97ab7ac339faba47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.235s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk 1073741824" returned: 0 in 0.063s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Cannot resize image /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG nova.objects.instance [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lazy-loading 'migration_context' on Instance uuid 0678e5e5-d3d8-43f0-937d-e367bd94329a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Ensure instance console log exists: /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Successfully created port: c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Successfully updated port: c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "refresh_cache-0678e5e5-d3d8-43f0-937d-e367bd94329a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquired lock "refresh_cache-0678e5e5-d3d8-43f0-937d-e367bd94329a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-f9938233-f080-473b-b7c3-5cea97a7517d req-6ba46363-a849-471d-99d8-69cb4d18e8ea service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received event network-changed-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-f9938233-f080-473b-b7c3-5cea97a7517d req-6ba46363-a849-471d-99d8-69cb4d18e8ea service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Refreshing instance network info cache due to event network-changed-c794b1f4-4544-422b-92d8-a08ff0fbc22b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f9938233-f080-473b-b7c3-5cea97a7517d req-6ba46363-a849-471d-99d8-69cb4d18e8ea service nova] Acquiring lock "refresh_cache-0678e5e5-d3d8-43f0-937d-e367bd94329a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updating instance_info_cache with network_info: [{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:02:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Updating instance_info_cache with network_info: [{"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Releasing lock "refresh_cache-0678e5e5-d3d8-43f0-937d-e367bd94329a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Instance network_info: |[{"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f9938233-f080-473b-b7c3-5cea97a7517d req-6ba46363-a849-471d-99d8-69cb4d18e8ea service nova] Acquired lock "refresh_cache-0678e5e5-d3d8-43f0-937d-e367bd94329a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-f9938233-f080-473b-b7c3-5cea97a7517d req-6ba46363-a849-471d-99d8-69cb4d18e8ea service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Refreshing network info cache for port c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Start _get_guest_xml network_info=[{"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:02:12 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:02:12 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2046663213',display_name='tempest-VolumesNegativeTest-instance-2046663213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2046663213',id=42,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c9a3513ed8408e97ab7ac339faba47',ramdisk_id='',reservation_id='r-720ld023',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1496227351',owner_user_name='tempest-VolumesNegativeTest-1496227351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:02:09Z,user_data=None,user_id='5a5e100257194a25b2f284f6192a6217',uuid=0678e5e5-d3d8-43f0-937d-e367bd94329a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Converting VIF {"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:54:63,bridge_name='br-int',has_traffic_filtering=True,id=c794b1f4-4544-422b-92d8-a08ff0fbc22b,network=Network(f1f71048-d03e-4c47-9c07-1c85c7939802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc794b1f4-45') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lazy-loading 'pci_devices' on Instance uuid 0678e5e5-d3d8-43f0-937d-e367bd94329a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:02:12 user nova-compute[73007]:   <uuid>0678e5e5-d3d8-43f0-937d-e367bd94329a</uuid>
Aug 15 18:02:12 user nova-compute[73007]:   <name>instance-0000002a</name>
Aug 15 18:02:12 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:02:12 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:02:12 user nova-compute[73007]:   <metadata>
Aug 15 18:02:12 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:02:12 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:02:12 user nova-compute[73007]:       <nova:name>tempest-VolumesNegativeTest-instance-2046663213</nova:name>
Aug 15 18:02:12 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:02:12</nova:creationTime>
Aug 15 18:02:12 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:02:12 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:02:12 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:02:12 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:02:12 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:02:12 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:02:12 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:02:12 user nova-compute[73007]:       <nova:owner>
Aug 15 18:02:12 user nova-compute[73007]:         <nova:user uuid="5a5e100257194a25b2f284f6192a6217">tempest-VolumesNegativeTest-1496227351-project-member</nova:user>
Aug 15 18:02:12 user nova-compute[73007]:         <nova:project uuid="89c9a3513ed8408e97ab7ac339faba47">tempest-VolumesNegativeTest-1496227351</nova:project>
Aug 15 18:02:12 user nova-compute[73007]:       </nova:owner>
Aug 15 18:02:12 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:02:12 user nova-compute[73007]:       <nova:ports>
Aug 15 18:02:12 user nova-compute[73007]:         <nova:port uuid="c794b1f4-4544-422b-92d8-a08ff0fbc22b">
Aug 15 18:02:12 user nova-compute[73007]:           <nova:ip type="fixed" address="192.168.233.49" ipVersion="4"/>
Aug 15 18:02:12 user nova-compute[73007]:         </nova:port>
Aug 15 18:02:12 user nova-compute[73007]:       </nova:ports>
Aug 15 18:02:12 user nova-compute[73007]:     </nova:instance>
Aug 15 18:02:12 user nova-compute[73007]:   </metadata>
Aug 15 18:02:12 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:02:12 user nova-compute[73007]:     <system>
Aug 15 18:02:12 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:02:12 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:02:12 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:02:12 user nova-compute[73007]:       <entry name="serial">0678e5e5-d3d8-43f0-937d-e367bd94329a</entry>
Aug 15 18:02:12 user nova-compute[73007]:       <entry name="uuid">0678e5e5-d3d8-43f0-937d-e367bd94329a</entry>
Aug 15 18:02:12 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:02:12 user nova-compute[73007]:     </system>
Aug 15 18:02:12 user nova-compute[73007]:   </sysinfo>
Aug 15 18:02:12 user nova-compute[73007]:   <os>
Aug 15 18:02:12 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:02:12 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:02:12 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:02:12 user nova-compute[73007]:   </os>
Aug 15 18:02:12 user nova-compute[73007]:   <features>
Aug 15 18:02:12 user nova-compute[73007]:     <acpi/>
Aug 15 18:02:12 user nova-compute[73007]:     <apic/>
Aug 15 18:02:12 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:02:12 user nova-compute[73007]:   </features>
Aug 15 18:02:12 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:02:12 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:02:12 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:02:12 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:02:12 user nova-compute[73007]:   </clock>
Aug 15 18:02:12 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:02:12 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:02:12 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:02:12 user nova-compute[73007]:   </cpu>
Aug 15 18:02:12 user nova-compute[73007]:   <devices>
Aug 15 18:02:12 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:02:12 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:02:12 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk"/>
Aug 15 18:02:12 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:02:12 user nova-compute[73007]:     </disk>
Aug 15 18:02:12 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:02:12 user nova-compute[73007]:       <mac address="fa:16:3e:7c:54:63"/>
Aug 15 18:02:12 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:02:12 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:02:12 user nova-compute[73007]:       <target dev="tapc794b1f4-45"/>
Aug 15 18:02:12 user nova-compute[73007]:     </interface>
Aug 15 18:02:12 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:02:12 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/console.log" append="off"/>
Aug 15 18:02:12 user nova-compute[73007]:     </serial>
Aug 15 18:02:12 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:02:12 user nova-compute[73007]:     <video>
Aug 15 18:02:12 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:02:12 user nova-compute[73007]:     </video>
Aug 15 18:02:12 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:02:12 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:02:12 user nova-compute[73007]:     </rng>
Aug 15 18:02:12 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:02:12 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:02:12 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:02:12 user nova-compute[73007]:     </memballoon>
Aug 15 18:02:12 user nova-compute[73007]:   </devices>
Aug 15 18:02:12 user nova-compute[73007]: </domain>
Aug 15 18:02:12 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2046663213',display_name='tempest-VolumesNegativeTest-instance-2046663213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2046663213',id=42,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89c9a3513ed8408e97ab7ac339faba47',ramdisk_id='',reservation_id='r-720ld023',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1496227351',owner_user_name='tempest-VolumesNegativeTest-1496227351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:02:09Z,user_data=None,user_id='5a5e100257194a25b2f284f6192a6217',uuid=0678e5e5-d3d8-43f0-937d-e367bd94329a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Converting VIF {"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:54:63,bridge_name='br-int',has_traffic_filtering=True,id=c794b1f4-4544-422b-92d8-a08ff0fbc22b,network=Network(f1f71048-d03e-4c47-9c07-1c85c7939802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc794b1f4-45') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG os_vif [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:54:63,bridge_name='br-int',has_traffic_filtering=True,id=c794b1f4-4544-422b-92d8-a08ff0fbc22b,network=Network(f1f71048-d03e-4c47-9c07-1c85c7939802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc794b1f4-45') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc794b1f4-45, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc794b1f4-45, col_values=(('external_ids', {'iface-id': 'c794b1f4-4544-422b-92d8-a08ff0fbc22b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:54:63', 'vm-uuid': '0678e5e5-d3d8-43f0-937d-e367bd94329a'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:12 user nova-compute[73007]: INFO os_vif [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:54:63,bridge_name='br-int',has_traffic_filtering=True,id=c794b1f4-4544-422b-92d8-a08ff0fbc22b,network=Network(f1f71048-d03e-4c47-9c07-1c85c7939802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc794b1f4-45')
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] No VIF found with MAC fa:16:3e:7c:54:63, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-f9938233-f080-473b-b7c3-5cea97a7517d req-6ba46363-a849-471d-99d8-69cb4d18e8ea service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Updated VIF entry in instance network info cache for port c794b1f4-4544-422b-92d8-a08ff0fbc22b. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-f9938233-f080-473b-b7c3-5cea97a7517d req-6ba46363-a849-471d-99d8-69cb4d18e8ea service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Updating instance_info_cache with network_info: [{"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f9938233-f080-473b-b7c3-5cea97a7517d req-6ba46363-a849-471d-99d8-69cb4d18e8ea service nova] Releasing lock "refresh_cache-0678e5e5-d3d8-43f0-937d-e367bd94329a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJpLHfVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:13 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:13 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:13 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-e3a6b600-5322-4d10-a157-a053c2694347 req-c9c911d6-da46-4852-8d18-3539cf7feb1d service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received event network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e3a6b600-5322-4d10-a157-a053c2694347 req-c9c911d6-da46-4852-8d18-3539cf7feb1d service nova] Acquiring lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e3a6b600-5322-4d10-a157-a053c2694347 req-c9c911d6-da46-4852-8d18-3539cf7feb1d service nova] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e3a6b600-5322-4d10-a157-a053c2694347 req-c9c911d6-da46-4852-8d18-3539cf7feb1d service nova] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-e3a6b600-5322-4d10-a157-a053c2694347 req-c9c911d6-da46-4852-8d18-3539cf7feb1d service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] No waiting events found dispatching network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:13 user nova-compute[73007]: WARNING nova.compute.manager [req-e3a6b600-5322-4d10-a157-a053c2694347 req-c9c911d6-da46-4852-8d18-3539cf7feb1d service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received unexpected event network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b for instance with vm_state building and task_state spawning.
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2733e2b4-8707-4fc7-9c55-0dfb7d2f0140]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:02:13 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[514566f7-b7c9-4697-bdd9-a7fcc2233e2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704] added
Aug 15 18:02:13 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b22aa71-e594-4ed3-8c9c-4256a404b924]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25367e1-3c95-4a28-8163-fe9e74d3830e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJpLHfVq {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJpLHfVq" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcdfade-6f32-40af-8d60-3f1cedb41206]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sJpLHfVq'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b054f6a-6124-46a3-85bc-79174d05fded]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd5c232-3aae-4983-b7c4-1ce98caeddb8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7e423c-29b7-4e0c-a326-ad1d0fe60c04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704, portal: 172.16.0.220,3260]
Aug 15 18:02:14 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704, portal: 172.16.0.220,3260] successful.
Aug 15 18:02:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3409ad1-382d-47e5-b744-8b66e2ac7d5e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22a7832-50b5-427e-b680-101d65ec8913]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:14 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f78a109-b524-4da4-8cb7-87eef66e37e6]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJpLHfVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '23363386161666531', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363386161666531', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'flavor' on Instance uuid 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:02:15 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:02:15 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 18:02:15 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:02:15 user nova-compute[73007]:   <serial>2517b212-2eb9-4bba-b26e-b35e1b1a5704</serial>
Aug 15 18:02:15 user nova-compute[73007]: </disk>
Aug 15 18:02:15 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNOjuien', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:15 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:15 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:15 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5f5325-b815-4c3e-a7ce-efbfc3b35633]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:02:15 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa694e8f-4875-4798-9201-50c0ad179dd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1] added
Aug 15 18:02:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7788af76-d256-44dc-9764-47b1b463bfc0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a8adfc-4f82-491e-97fe-297c462770f7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNOjuien {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNOjuien" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b8a5fb-2507-462c-b631-1becce0f1261]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zNOjuien'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3b4b9-beea-442f-809c-5bcf43421da4]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3700b84b-7afa-4625-9aa4-b4aa8f5cd348]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No VIF found with MAC fa:16:3e:1d:ca:a3, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[90247eea-a9e8-450a-a629-febe7174f586]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1, portal: 172.16.0.220,3260]
Aug 15 18:02:15 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1, portal: 172.16.0.220,3260] successful.
Aug 15 18:02:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be5b60e-4e7f-4548-99b0-1e028e3d5b4e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122535.9503293, 0678e5e5-d3d8-43f0-937d-e367bd94329a => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:02:15 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] VM Resumed (Lifecycle Event)
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[90578b20-d4a6-45e2-aeec-358e0d45a3e0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)
Aug 15 18:02:15 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:02:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Instance spawned successfully.
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[460677f6-9ca9-4330-bfe1-9347a576bff2]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNOjuien', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3c0ffa65-a942-442d-b9eb-088b80f1a3f3 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.546s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-22bee89b-6a49-4bc6-8888-ccff4bc53cfb req-2bf3bf82-0419-471e-baa4-e620d793b4e0 service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received event network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-22bee89b-6a49-4bc6-8888-ccff4bc53cfb req-2bf3bf82-0419-471e-baa4-e620d793b4e0 service nova] Acquiring lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-22bee89b-6a49-4bc6-8888-ccff4bc53cfb req-2bf3bf82-0419-471e-baa4-e620d793b4e0 service nova] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-22bee89b-6a49-4bc6-8888-ccff4bc53cfb req-2bf3bf82-0419-471e-baa4-e620d793b4e0 service nova] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-22bee89b-6a49-4bc6-8888-ccff4bc53cfb req-2bf3bf82-0419-471e-baa4-e620d793b4e0 service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] No waiting events found dispatching network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:16 user nova-compute[73007]: WARNING nova.compute.manager [req-22bee89b-6a49-4bc6-8888-ccff4bc53cfb req-2bf3bf82-0419-471e-baa4-e620d793b4e0 service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received unexpected event network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b for instance with vm_state building and task_state spawning.
Aug 15 18:02:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122535.9522207, 0678e5e5-d3d8-43f0-937d-e367bd94329a => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:02:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] VM Started (Lifecycle Event)
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:02:16 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:16 user nova-compute[73007]: INFO nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Took 6.75 seconds to spawn the instance on the hypervisor.
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:16 user nova-compute[73007]: INFO nova.compute.manager [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Took 7.81 seconds to build instance.
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-81ad6cb7-9417-4fcd-8052-18819a3c7d69 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.906s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:16 user nova-compute[73007]: INFO nova.compute.manager [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Terminating instance
Aug 15 18:02:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '26635613736313032', 'path': '/dev/sdf'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635613736313032', 'path': '/dev/sdf'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:02:17 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:02:17 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 18:02:17 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:02:17 user nova-compute[73007]:   <serial>9271916a-06cd-4e27-9cff-7f51bc1a4af1</serial>
Aug 15 18:02:17 user nova-compute[73007]: </disk>
Aug 15 18:02:17 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] No VIF found with MAC fa:16:3e:6b:92:1b, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a45481e5-e238-4002-9a3a-4f6abf817654 tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.811s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Instance destroyed successfully.
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'resources' on Instance uuid 262a67eb-42f3-4c9f-841b-29096e5b6b0b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1522747174',display_name='tempest-TestVolumeBootPattern-server-1522747174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1522747174',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-ahv0ijms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:00:52Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=262a67eb-42f3-4c9f-841b-29096e5b6b0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e7:30,bridge_name='br-int',has_traffic_filtering=True,id=c032d20a-c59f-4c6c-8377-01ca95aa4c4a,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc032d20a-c5') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_vif [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e7:30,bridge_name='br-int',has_traffic_filtering=True,id=c032d20a-c59f-4c6c-8377-01ca95aa4c4a,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc032d20a-c5') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc032d20a-c5, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:02:18 user nova-compute[73007]: INFO os_vif [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:e7:30,bridge_name='br-int',has_traffic_filtering=True,id=c032d20a-c59f-4c6c-8377-01ca95aa4c4a,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc032d20a-c5')
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtHngFJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:18 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[16033dec-3b82-418d-b947-83a2a963fb07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-changed-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Refreshing instance network info cache due to event network-changed-c032d20a-c59f-4c6c-8377-01ca95aa4c4a. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Acquiring lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Acquired lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.network.neutron [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Refreshing network info cache for port c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b229064-32fb-4585-937e-9c5df8361eac]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:18 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:18 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:18 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:18 user nova-compute[73007]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)
Aug 15 18:02:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:18 user nova-compute[73007]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:02:18 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:18 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:18 user nova-compute[73007]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)
Aug 15 18:02:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c5ed510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dad202-060a-45da-a7fd-1aef17cffb29]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ebe414-d9b4-4f8b-9096-1a026a8250d6]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15de6b1-32d0-4793-b442-51ca0bb9f589]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaca99a-b451-4358-a90e-551bbfbafb7a]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c63bf71-77a5-4117-ba5a-5c02a98670fd]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d31950e-16a8-494e-bd4b-641678c8be3d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260]
Aug 15 18:02:18 user nova-compute[73007]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260] successful.
Aug 15 18:02:18 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b91440-2571-497f-983e-d045bf3974fc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== disconnect_volume: return (423ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:02:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Deleting instance files /opt/stack/data/nova/instances/262a67eb-42f3-4c9f-841b-29096e5b6b0b_del
Aug 15 18:02:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Deletion of /opt/stack/data/nova/instances/262a67eb-42f3-4c9f-841b-29096e5b6b0b_del complete
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:18 user nova-compute[73007]: INFO nova.compute.manager [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Took 1.83 seconds to destroy the instance on the hypervisor.
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Updated VIF entry in instance network info cache for port c032d20a-c59f-4c6c-8377-01ca95aa4c4a. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Updating instance_info_cache with network_info: [{"id": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "address": "fa:16:3e:1b:e7:30", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc032d20a-c5", "ovs_interfaceid": "c032d20a-c59f-4c6c-8377-01ca95aa4c4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:19 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:02:19 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7126MB free_disk=25.003074645996094GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Releasing lock "refresh_cache-262a67eb-42f3-4c9f-841b-29096e5b6b0b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-unplugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] No waiting events found dispatching network-vif-unplugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-unplugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] No waiting events found dispatching network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:19 user nova-compute[73007]: WARNING nova.compute.manager [req-a44fd130-f29f-402b-85d9-532a5079e6ce req-226c8546-de7f-4af2-a927-eccb02b64043 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received unexpected event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a for instance with vm_state active and task_state deleting.
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:19 user nova-compute[73007]: INFO nova.compute.manager [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Detaching volume 2517b212-2eb9-4bba-b26e-b35e1b1a5704
Aug 15 18:02:19 user nova-compute[73007]: INFO nova.virt.block_device [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Attempting to driver detach volume 2517b212-2eb9-4bba-b26e-b35e1b1a5704 from mountpoint /dev/vdb
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-c6a71cf2-d535-4d5d-99f5-b3ca4abae219 req-b7f81557-5eec-4656-9942-3098ec5c1993 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-deleted-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:19 user nova-compute[73007]: INFO nova.compute.manager [req-c6a71cf2-d535-4d5d-99f5-b3ca4abae219 req-b7f81557-5eec-4656-9942-3098ec5c1993 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Neutron deleted interface c032d20a-c59f-4c6c-8377-01ca95aa4c4a; detaching it from the instance and deleting it from the info cache
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-c6a71cf2-d535-4d5d-99f5-b3ca4abae219 req-b7f81557-5eec-4656-9942-3098ec5c1993 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Attempting to detach device vdb from instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:02:19 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:02:19 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 18:02:19 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:02:19 user nova-compute[73007]:   <serial>2517b212-2eb9-4bba-b26e-b35e1b1a5704</serial>
Aug 15 18:02:19 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:02:19 user nova-compute[73007]: </disk>
Aug 15 18:02:19 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Successfully detached device vdb from instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 from the persistent domain config.
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:02:19 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:02:19 user nova-compute[73007]:   <source dev="/dev/sde"/>
Aug 15 18:02:19 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:02:19 user nova-compute[73007]:   <serial>2517b212-2eb9-4bba-b26e-b35e1b1a5704</serial>
Aug 15 18:02:19 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:02:19 user nova-compute[73007]: </disk>
Aug 15 18:02:19 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 029c5519-9937-439c-9fc7-f1bad76d26f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 262a67eb-42f3-4c9f-841b-29096e5b6b0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance da287ce9-0600-43be-94aa-038eb1edaf07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5d29f229-4024-4a0e-b18a-b7a79de8c583 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6545b6a7-4c0e-4d97-8c98-7491292c566a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 0678e5e5-d3d8-43f0-937d-e367bd94329a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:02:19 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Took 1.14 seconds to deallocate network for instance.
Aug 15 18:02:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-c6a71cf2-d535-4d5d-99f5-b3ca4abae219 req-b7f81557-5eec-4656-9942-3098ec5c1993 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Detach interface failed, port_id=c032d20a-c59f-4c6c-8377-01ca95aa4c4a, reason: Instance 262a67eb-42f3-4c9f-841b-29096e5b6b0b could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:19 user nova-compute[73007]: INFO nova.compute.manager [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Detaching volume 9271916a-06cd-4e27-9cff-7f51bc1a4af1
Aug 15 18:02:20 user nova-compute[73007]: INFO nova.virt.block_device [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Attempting to driver detach volume 9271916a-06cd-4e27-9cff-7f51bc1a4af1 from mountpoint /dev/vdb
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Attempting to detach device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:02:20 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:02:20 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 18:02:20 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:02:20 user nova-compute[73007]:   <serial>9271916a-06cd-4e27-9cff-7f51bc1a4af1</serial>
Aug 15 18:02:20 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:02:20 user nova-compute[73007]: </disk>
Aug 15 18:02:20 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:02:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully detached device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the persistent domain config.
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:02:20 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:02:20 user nova-compute[73007]:   <source dev="/dev/sdf"/>
Aug 15 18:02:20 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:02:20 user nova-compute[73007]:   <serial>9271916a-06cd-4e27-9cff-7f51bc1a4af1</serial>
Aug 15 18:02:20 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:02:20 user nova-compute[73007]: </disk>
Aug 15 18:02:20 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] No waiting events found dispatching network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:20 user nova-compute[73007]: WARNING nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received unexpected event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a for instance with vm_state active and task_state deleting.
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] No waiting events found dispatching network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:20 user nova-compute[73007]: WARNING nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received unexpected event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a for instance with vm_state active and task_state deleting.
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-unplugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] No waiting events found dispatching network-vif-unplugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-unplugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Acquiring lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] No waiting events found dispatching network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:20 user nova-compute[73007]: WARNING nova.compute.manager [req-2706f013-adcd-40d3-8f96-8861a4c46491 req-321534d8-f70a-4a45-8a66-b94925efb4a1 service nova] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Received unexpected event network-vif-plugged-c032d20a-c59f-4c6c-8377-01ca95aa4c4a for instance with vm_state active and task_state deleting.
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122540.3157635, 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:02:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Successfully detached device vdb from instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 from the live domain config.
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJpLHfVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:20 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcd5a38-3acc-4d67-b63e-ea73f824836c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b87a19-30c0-4f55-85d3-2a41b6c84752]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11505e1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.760s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cdb77b-90c3-4c1e-949e-61de9e7499c0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9835f0-491b-46c9-8a8b-addc46f7b596]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a31032-5f3c-43e8-bdc3-32826782ef28]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9452c40b-4c85-4f14-8642-63c17d270429]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea7bb0d-21e2-401d-807e-32a0f1c9a518]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122540.6268945, 029c5519-9937-439c-9fc7-f1bad76d26f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:02:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully detached device vdb from instance 029c5519-9937-439c-9fc7-f1bad76d26f9 from the live domain config.
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNOjuien', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:20 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a920f75-e988-4cf3-986b-8dcca854a709]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704, portal: 172.16.0.220,3260]
Aug 15 18:02:20 user nova-compute[73007]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704, portal: 172.16.0.220,3260] successful.
Aug 15 18:02:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2517b212-2eb9-4bba-b26e-b35e1b1a5704 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc5f391-19e4-4b29-99ea-3b260940c84f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] <== disconnect_volume: return (392ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.070s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd09de56-f861-4519-925a-98dce5b3d643]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b954c6-c5ca-4a50-ba06-4f33cf0f23de]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:20 user nova-compute[73007]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 (non-flash)
Aug 15 18:02:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11507ce320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1'): ({'sdf'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Removing single pathed devices sdf {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f76442e-e961-4f06-90fb-4fe34f9fd22d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[57de25f5-7369-4313-bdd2-39d8a369c13e]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Flushing IO for device /dev/sdf {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: INFO nova.compute.manager [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Took 0.93 seconds to detach 1 volumes for instance.
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[69584534-3a91-41fb-ae10-ec10f1879a91]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.064s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb558035-941b-4ff3-8440-3310deb00079]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c82b465-feb7-494b-867b-f6230b4e1922]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccd4c72-3e82-44e0-b295-adc862002778]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1, portal: 172.16.0.220,3260]
Aug 15 18:02:21 user nova-compute[73007]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1, portal: 172.16.0.220,3260] successful.
Aug 15 18:02:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9271916a-06cd-4e27-9cff-7f51bc1a4af1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0430b7f9-b492-4f72-a7ea-128166781e90]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] <== disconnect_volume: return (390ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:21 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Deleted allocations for instance 262a67eb-42f3-4c9f-841b-29096e5b6b0b
Aug 15 18:02:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1c015ba4-2e53-4ac1-af8e-8afc0c5b6bd0 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "262a67eb-42f3-4c9f-841b-29096e5b6b0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.577s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'flavor' on Instance uuid 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4ec43f05-8f1a-411b-9395-9f039cc374db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.994s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG nova.objects.instance [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'flavor' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d1d86ab4-8c21-4b42-90c6-074c9cb8366f tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.074s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-0883a0c0-58d5-4d2c-91a0-4e851498c2cb req-b45cbc99-e523-42e0-be54-dfc75c1211de service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-changed-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG nova.compute.manager [req-0883a0c0-58d5-4d2c-91a0-4e851498c2cb req-b45cbc99-e523-42e0-be54-dfc75c1211de service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Refreshing instance network info cache due to event network-changed-f98c5145-23fc-4228-bf00-2a399bb280f0. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0883a0c0-58d5-4d2c-91a0-4e851498c2cb req-b45cbc99-e523-42e0-be54-dfc75c1211de service nova] Acquiring lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0883a0c0-58d5-4d2c-91a0-4e851498c2cb req-b45cbc99-e523-42e0-be54-dfc75c1211de service nova] Acquired lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG nova.network.neutron [req-0883a0c0-58d5-4d2c-91a0-4e851498c2cb req-b45cbc99-e523-42e0-be54-dfc75c1211de service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Refreshing network info cache for port f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'flavor' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:23 user nova-compute[73007]: INFO nova.compute.manager [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Attaching volume 1b85a393-a180-43dc-8cc2-113aa2cc6fa4 to /dev/vdb
Aug 15 18:02:23 user nova-compute[73007]: DEBUG os_brick.utils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c656dd14-383f-422d-8c95-3013b3cdd9d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c4c91-8fa5-4e8d-961b-cd928b9aeeb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG nova.network.neutron [req-0883a0c0-58d5-4d2c-91a0-4e851498c2cb req-b45cbc99-e523-42e0-be54-dfc75c1211de service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updated VIF entry in instance network info cache for port f98c5145-23fc-4228-bf00-2a399bb280f0. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG nova.network.neutron [req-0883a0c0-58d5-4d2c-91a0-4e851498c2cb req-b45cbc99-e523-42e0-be54-dfc75c1211de service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8073e-e56c-4a02-963c-925c95abe388]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb885cf8-32e0-496d-89ab-124f4aa88842]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0883a0c0-58d5-4d2c-91a0-4e851498c2cb req-b45cbc99-e523-42e0-be54-dfc75c1211de service nova] Releasing lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:02:23 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:02:23 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f896f5e3-30b9-4d80-a166-f9837cabf138]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG os_brick.utils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:23 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating existing volume attachment record: 7ab0eba2-a1a2-4a04-878d-87f6f5c510d8 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:02:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfytiqnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:32 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:32 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:32 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99fe5b3-7910-4188-ba68-45e1442b63e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:02:32 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb4374-6b95-4b8e-9a54-4899cc12f43a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4] added
Aug 15 18:02:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5170f670-7bef-41ce-bb11-434019e6c7fe]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16619ae-4a76-40bf-bb26-a2828cec0a67]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfytiqnG {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfytiqnG" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b52faee-3dab-4dea-8388-c6b794bf25d8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfytiqnG'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9b7b98-7d14-4c8e-9b4d-dc08ae825afa]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[49115813-2130-4128-bf68-a815f10ed664]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:32 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:32 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ece1e24-2ab3-4089-9400-37046b1934c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4, portal: 172.16.0.220,3260]
Aug 15 18:02:32 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4, portal: 172.16.0.220,3260] successful.
Aug 15 18:02:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dc47bd-7b97-41ec-9511-7bde3ae94959]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eeba70-95a3-408a-b601-fc6ec11d8ec0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:32 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:32 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:02:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:32 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:32 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:02:32 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed196e1-f29f-46be-87c9-19880cf54d29]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:02:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfytiqnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122538.0078201, 262a67eb-42f3-4c9f-841b-29096e5b6b0b => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:02:33 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] VM Stopped (Lifecycle Event)
Aug 15 18:02:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b1f7eb3e-5cc5-4e9e-b682-e489a5a3aef4 None None] [instance: 262a67eb-42f3-4c9f-841b-29096e5b6b0b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23931643464373332', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931643464373332', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'flavor' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:02:33 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:02:33 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:02:33 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:02:33 user nova-compute[73007]:   <serial>1b85a393-a180-43dc-8cc2-113aa2cc6fa4</serial>
Aug 15 18:02:33 user nova-compute[73007]: </disk>
Aug 15 18:02:33 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No VIF found with MAC fa:16:3e:9e:3c:6d, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:02:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6647993c-9394-45fb-b6c4-738db04881aa tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.978s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:02:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:34 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:02:34 user nova-compute[73007]: INFO nova.compute.claims [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Claim successful on node user
Aug 15 18:02:35 user nova-compute[73007]: INFO nova.compute.manager [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Rescuing
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquired lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:02:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.policy [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52391420381427297cc8c55600112b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09ba0a5fb91043d9a46323b202cd924c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:02:35 user nova-compute[73007]: INFO nova.virt.block_device [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Booting with volume 66b06d0a-bef1-4068-bf1c-dfcb78d979ef at /dev/vda
Aug 15 18:02:35 user nova-compute[73007]: DEBUG os_brick.utils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[530619f6-e0d4-49a1-932c-e619a82d506a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a83460-826f-4aa8-929f-1f28f6c95384]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f191e1-b918-4366-b842-9958b3b6181c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a609612c-be02-40a3-a255-0d76e8bdadbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Releasing lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:02:35 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:02:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf591e38-5c2d-48ec-8032-27bb42cc5fad]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG os_brick.utils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:35 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating existing volume attachment record: 36a5123c-f244-49d6-85b2-97cc54a6f61f {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-7099c802-d57e-4965-a01e-213c14e7db95 req-d772ea3d-6b52-47e9-9691-dcb8dfec79ab service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7099c802-d57e-4965-a01e-213c14e7db95 req-d772ea3d-6b52-47e9-9691-dcb8dfec79ab service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7099c802-d57e-4965-a01e-213c14e7db95 req-d772ea3d-6b52-47e9-9691-dcb8dfec79ab service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7099c802-d57e-4965-a01e-213c14e7db95 req-d772ea3d-6b52-47e9-9691-dcb8dfec79ab service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-7099c802-d57e-4965-a01e-213c14e7db95 req-d772ea3d-6b52-47e9-9691-dcb8dfec79ab service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:36 user nova-compute[73007]: WARNING nova.compute.manager [req-7099c802-d57e-4965-a01e-213c14e7db95 req-d772ea3d-6b52-47e9-9691-dcb8dfec79ab service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state active and task_state rescuing.
Aug 15 18:02:36 user nova-compute[73007]: DEBUG nova.network.neutron [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Successfully created port: 96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:02:36 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance destroyed successfully.
Aug 15 18:02:36 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Attempting rescue
Aug 15 18:02:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73007) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance directory exists: not creating {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 18:02:36 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Creating image(s)
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'trusted_certs' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue" returned: 0 in 0.049s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'migration_context' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Start _get_guest_xml network_info=[{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:9e:3c:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'resources' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'numa_topology' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:37 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:02:37 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'vcpu_model' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1475833445',display_name='tempest-ServerRescueNegativeTestJSON-server-1475833445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1475833445',id=39,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6C1KYKxf38rOwazJQZLOHCxAe4Mz4s81UJd04jHbux9L0G8Yk3C/k3ldVklTUJR5Ibv+Iv0VuGhVgS70ITXzaektW1NMxhLGHAsQg3vXL66frE4sFgjnqpkdxXMSS8XQ==',key_name='tempest-keypair-1271983282',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-m5enh7lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:00:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=da287ce9-0600-43be-94aa-038eb1edaf07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:9e:3c:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "vif_mac": "fa:16:3e:9e:3c:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=f98c5145-23fc-4228-bf00-2a399bb280f0,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98c5145-23') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'pci_devices' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:02:37 user nova-compute[73007]:   <uuid>da287ce9-0600-43be-94aa-038eb1edaf07</uuid>
Aug 15 18:02:37 user nova-compute[73007]:   <name>instance-00000027</name>
Aug 15 18:02:37 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:02:37 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:02:37 user nova-compute[73007]:   <metadata>
Aug 15 18:02:37 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:02:37 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:02:37 user nova-compute[73007]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1475833445</nova:name>
Aug 15 18:02:37 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:02:37</nova:creationTime>
Aug 15 18:02:37 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:02:37 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:02:37 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:02:37 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:02:37 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:02:37 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:02:37 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:02:37 user nova-compute[73007]:       <nova:owner>
Aug 15 18:02:37 user nova-compute[73007]:         <nova:user uuid="f886ee6939504c4b9a406cedb9a65acc">tempest-ServerRescueNegativeTestJSON-1846740548-project-member</nova:user>
Aug 15 18:02:37 user nova-compute[73007]:         <nova:project uuid="8f94edb7a50c4e0e97ddc96c5c0028fc">tempest-ServerRescueNegativeTestJSON-1846740548</nova:project>
Aug 15 18:02:37 user nova-compute[73007]:       </nova:owner>
Aug 15 18:02:37 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:02:37 user nova-compute[73007]:       <nova:ports>
Aug 15 18:02:37 user nova-compute[73007]:         <nova:port uuid="f98c5145-23fc-4228-bf00-2a399bb280f0">
Aug 15 18:02:37 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 18:02:37 user nova-compute[73007]:         </nova:port>
Aug 15 18:02:37 user nova-compute[73007]:       </nova:ports>
Aug 15 18:02:37 user nova-compute[73007]:     </nova:instance>
Aug 15 18:02:37 user nova-compute[73007]:   </metadata>
Aug 15 18:02:37 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:02:37 user nova-compute[73007]:     <system>
Aug 15 18:02:37 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:02:37 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:02:37 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:02:37 user nova-compute[73007]:       <entry name="serial">da287ce9-0600-43be-94aa-038eb1edaf07</entry>
Aug 15 18:02:37 user nova-compute[73007]:       <entry name="uuid">da287ce9-0600-43be-94aa-038eb1edaf07</entry>
Aug 15 18:02:37 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:02:37 user nova-compute[73007]:     </system>
Aug 15 18:02:37 user nova-compute[73007]:   </sysinfo>
Aug 15 18:02:37 user nova-compute[73007]:   <os>
Aug 15 18:02:37 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:02:37 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:02:37 user nova-compute[73007]:   </os>
Aug 15 18:02:37 user nova-compute[73007]:   <features>
Aug 15 18:02:37 user nova-compute[73007]:     <acpi/>
Aug 15 18:02:37 user nova-compute[73007]:     <apic/>
Aug 15 18:02:37 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:02:37 user nova-compute[73007]:   </features>
Aug 15 18:02:37 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:02:37 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:02:37 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:02:37 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:02:37 user nova-compute[73007]:   </clock>
Aug 15 18:02:37 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:02:37 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:02:37 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:02:37 user nova-compute[73007]:   </cpu>
Aug 15 18:02:37 user nova-compute[73007]:   <devices>
Aug 15 18:02:37 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:02:37 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:02:37 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue"/>
Aug 15 18:02:37 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:02:37 user nova-compute[73007]:     </disk>
Aug 15 18:02:37 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:02:37 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:02:37 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk"/>
Aug 15 18:02:37 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 18:02:37 user nova-compute[73007]:     </disk>
Aug 15 18:02:37 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:02:37 user nova-compute[73007]:       <mac address="fa:16:3e:9e:3c:6d"/>
Aug 15 18:02:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:02:37 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:02:37 user nova-compute[73007]:       <target dev="tapf98c5145-23"/>
Aug 15 18:02:37 user nova-compute[73007]:     </interface>
Aug 15 18:02:37 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:02:37 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/console.log" append="off"/>
Aug 15 18:02:37 user nova-compute[73007]:     </serial>
Aug 15 18:02:37 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:02:37 user nova-compute[73007]:     <video>
Aug 15 18:02:37 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:02:37 user nova-compute[73007]:     </video>
Aug 15 18:02:37 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:02:37 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:02:37 user nova-compute[73007]:     </rng>
Aug 15 18:02:37 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:02:37 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:02:37 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:02:37 user nova-compute[73007]:     </memballoon>
Aug 15 18:02:37 user nova-compute[73007]:   </devices>
Aug 15 18:02:37 user nova-compute[73007]: </domain>
Aug 15 18:02:37 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.network.neutron [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Successfully updated port: 96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:02:37 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance destroyed successfully.
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquired lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.network.neutron [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-d02d33b5-a8e6-4a8f-8b72-916c14f8612a req-d9ae85f4-36ee-4a2f-bc99-41785d5ac88a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-changed-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.compute.manager [req-d02d33b5-a8e6-4a8f-8b72-916c14f8612a req-d9ae85f4-36ee-4a2f-bc99-41785d5ac88a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Refreshing instance network info cache due to event network-changed-96ecbd22-c121-40ce-8f58-9c14788d09fb. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d02d33b5-a8e6-4a8f-8b72-916c14f8612a req-d9ae85f4-36ee-4a2f-bc99-41785d5ac88a service nova] Acquiring lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] No VIF found with MAC fa:16:3e:9e:3c:6d, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.network.neutron [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.network.neutron [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating instance_info_cache with network_info: [{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Releasing lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance network_info: |[{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d02d33b5-a8e6-4a8f-8b72-916c14f8612a req-d9ae85f4-36ee-4a2f-bc99-41785d5ac88a service nova] Acquired lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:37 user nova-compute[73007]: DEBUG nova.network.neutron [req-d02d33b5-a8e6-4a8f-8b72-916c14f8612a req-d9ae85f4-36ee-4a2f-bc99-41785d5ac88a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Refreshing network info cache for port 96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-d02d33b5-a8e6-4a8f-8b72-916c14f8612a req-d9ae85f4-36ee-4a2f-bc99-41785d5ac88a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updated VIF entry in instance network info cache for port 96ecbd22-c121-40ce-8f58-9c14788d09fb. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG nova.network.neutron [req-d02d33b5-a8e6-4a8f-8b72-916c14f8612a req-d9ae85f4-36ee-4a2f-bc99-41785d5ac88a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating instance_info_cache with network_info: [{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d02d33b5-a8e6-4a8f-8b72-916c14f8612a req-d9ae85f4-36ee-4a2f-bc99-41785d5ac88a service nova] Releasing lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-855fc36f-1a81-456d-94f6-bb8759a82b54 req-ec1203eb-ccbd-4ea8-a07f-c4217a2d8cad service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-855fc36f-1a81-456d-94f6-bb8759a82b54 req-ec1203eb-ccbd-4ea8-a07f-c4217a2d8cad service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-855fc36f-1a81-456d-94f6-bb8759a82b54 req-ec1203eb-ccbd-4ea8-a07f-c4217a2d8cad service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-855fc36f-1a81-456d-94f6-bb8759a82b54 req-ec1203eb-ccbd-4ea8-a07f-c4217a2d8cad service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-855fc36f-1a81-456d-94f6-bb8759a82b54 req-ec1203eb-ccbd-4ea8-a07f-c4217a2d8cad service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:38 user nova-compute[73007]: WARNING nova.compute.manager [req-855fc36f-1a81-456d-94f6-bb8759a82b54 req-ec1203eb-ccbd-4ea8-a07f-c4217a2d8cad service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state active and task_state rescuing.
Aug 15 18:02:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:40 user nova-compute[73007]: WARNING nova.compute.manager [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state active and task_state rescuing.
Aug 15 18:02:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:40 user nova-compute[73007]: DEBUG nova.compute.manager [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:40 user nova-compute[73007]: WARNING nova.compute.manager [req-c3e513d6-010b-4036-b48a-61535a47bab2 req-82a32127-49d6-4e92-bd57-980aaccdd971 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state active and task_state rescuing.
Aug 15 18:02:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for da287ce9-0600-43be-94aa-038eb1edaf07 due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 18:02:41 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122561.1143, da287ce9-0600-43be-94aa-038eb1edaf07 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:02:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] VM Resumed (Lifecycle Event)
Aug 15 18:02:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ed971578-699b-4432-b254-85044168d9e5 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:02:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 18:02:41 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122561.1154833, da287ce9-0600-43be-94aa-038eb1edaf07 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:02:41 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] VM Started (Lifecycle Event)
Aug 15 18:02:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:02:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:02:45 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Creating image(s)
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Ensure instance console log exists: /opt/stack/data/nova/instances/693cc4d3-51fc-4d13-b5aa-832d22b1ebdd/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Start _get_guest_xml network_info=[{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBNEeqIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '693cc4d3-51fc-4d13-b5aa-832d22b1ebdd', 'attached_at': '', 'detached_at': '', 'volume_id': '66b06d0a-bef1-4068-bf1c-dfcb78d979ef', 'serial': '66b06d0a-bef1-4068-bf1c-dfcb78d979ef'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '36a5123c-f244-49d6-85b2-97cc54a6f61f', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:02:45 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:02:45 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBNEeqIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:02:45 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:45 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:02:45 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6668c7-2069-417f-b1ab-e16ab07bb503]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:02:45 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65588a34-7558-44d5-93a9-a256138da2be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef] added
Aug 15 18:02:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[211bcac3-2eeb-466c-92c0-02547651a286]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a57da-edae-4227-aec9-b32ab03b7002]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBNEeqIO {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBNEeqIO" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[436f460e-966a-44c3-a8fc-e809984ec260]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uBNEeqIO'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dcff99-e864-4142-8f3b-04b06c52f508]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2822be-d1e8-4262-9d8a-fef011f5bab8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:02:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:02:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba2bb19-8a07-445c-a4a4-5c4f9b0a728f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260]
Aug 15 18:02:45 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260] successful.
Aug 15 18:02:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4a1919-c429-4746-b73e-3779f6292563]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df55054-dd30-4ff5-a92a-3c0400604a98]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:02:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:02:45 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:02:45 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc5ad72-19a9-40a4-af81-c4ecc1a56474]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:02:45 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBNEeqIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26632386632366165', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632386632366165', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1151877584',display_name='tempest-ServerActionsTestOtherA-server-1151877584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1151877584',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-18dn6xtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=693cc4d3-51fc-4d13-b5aa-832d22b1ebdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:02:46 user nova-compute[73007]: DEBUG nova.objects.instance [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'pci_devices' on Instance uuid 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:02:47 user nova-compute[73007]:   <uuid>693cc4d3-51fc-4d13-b5aa-832d22b1ebdd</uuid>
Aug 15 18:02:47 user nova-compute[73007]:   <name>instance-0000002b</name>
Aug 15 18:02:47 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:02:47 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:02:47 user nova-compute[73007]:   <metadata>
Aug 15 18:02:47 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:02:47 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:02:47 user nova-compute[73007]:       <nova:name>tempest-ServerActionsTestOtherA-server-1151877584</nova:name>
Aug 15 18:02:47 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:02:45</nova:creationTime>
Aug 15 18:02:47 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:02:47 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:02:47 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:02:47 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:02:47 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:02:47 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:02:47 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:02:47 user nova-compute[73007]:       <nova:owner>
Aug 15 18:02:47 user nova-compute[73007]:         <nova:user uuid="d52391420381427297cc8c55600112b0">tempest-ServerActionsTestOtherA-226008880-project-member</nova:user>
Aug 15 18:02:47 user nova-compute[73007]:         <nova:project uuid="09ba0a5fb91043d9a46323b202cd924c">tempest-ServerActionsTestOtherA-226008880</nova:project>
Aug 15 18:02:47 user nova-compute[73007]:       </nova:owner>
Aug 15 18:02:47 user nova-compute[73007]:       <nova:ports>
Aug 15 18:02:47 user nova-compute[73007]:         <nova:port uuid="96ecbd22-c121-40ce-8f58-9c14788d09fb">
Aug 15 18:02:47 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 18:02:47 user nova-compute[73007]:         </nova:port>
Aug 15 18:02:47 user nova-compute[73007]:       </nova:ports>
Aug 15 18:02:47 user nova-compute[73007]:     </nova:instance>
Aug 15 18:02:47 user nova-compute[73007]:   </metadata>
Aug 15 18:02:47 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:02:47 user nova-compute[73007]:     <system>
Aug 15 18:02:47 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:02:47 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:02:47 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:02:47 user nova-compute[73007]:       <entry name="serial">693cc4d3-51fc-4d13-b5aa-832d22b1ebdd</entry>
Aug 15 18:02:47 user nova-compute[73007]:       <entry name="uuid">693cc4d3-51fc-4d13-b5aa-832d22b1ebdd</entry>
Aug 15 18:02:47 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:02:47 user nova-compute[73007]:     </system>
Aug 15 18:02:47 user nova-compute[73007]:   </sysinfo>
Aug 15 18:02:47 user nova-compute[73007]:   <os>
Aug 15 18:02:47 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:02:47 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:02:47 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:02:47 user nova-compute[73007]:   </os>
Aug 15 18:02:47 user nova-compute[73007]:   <features>
Aug 15 18:02:47 user nova-compute[73007]:     <acpi/>
Aug 15 18:02:47 user nova-compute[73007]:     <apic/>
Aug 15 18:02:47 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:02:47 user nova-compute[73007]:   </features>
Aug 15 18:02:47 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:02:47 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:02:47 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:02:47 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:02:47 user nova-compute[73007]:   </clock>
Aug 15 18:02:47 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:02:47 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:02:47 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:02:47 user nova-compute[73007]:   </cpu>
Aug 15 18:02:47 user nova-compute[73007]:   <devices>
Aug 15 18:02:47 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:02:47 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:02:47 user nova-compute[73007]:       <source dev="/dev/sde"/>
Aug 15 18:02:47 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:02:47 user nova-compute[73007]:       <serial>66b06d0a-bef1-4068-bf1c-dfcb78d979ef</serial>
Aug 15 18:02:47 user nova-compute[73007]:     </disk>
Aug 15 18:02:47 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:02:47 user nova-compute[73007]:       <mac address="fa:16:3e:29:55:3d"/>
Aug 15 18:02:47 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:02:47 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:02:47 user nova-compute[73007]:       <target dev="tap96ecbd22-c1"/>
Aug 15 18:02:47 user nova-compute[73007]:     </interface>
Aug 15 18:02:47 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:02:47 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/693cc4d3-51fc-4d13-b5aa-832d22b1ebdd/console.log" append="off"/>
Aug 15 18:02:47 user nova-compute[73007]:     </serial>
Aug 15 18:02:47 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:02:47 user nova-compute[73007]:     <video>
Aug 15 18:02:47 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:02:47 user nova-compute[73007]:     </video>
Aug 15 18:02:47 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:02:47 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:02:47 user nova-compute[73007]:     </rng>
Aug 15 18:02:47 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:02:47 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:02:47 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:02:47 user nova-compute[73007]:     </memballoon>
Aug 15 18:02:47 user nova-compute[73007]:   </devices>
Aug 15 18:02:47 user nova-compute[73007]: </domain>
Aug 15 18:02:47 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1151877584',display_name='tempest-ServerActionsTestOtherA-server-1151877584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1151877584',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-18dn6xtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=693cc4d3-51fc-4d13-b5aa-832d22b1ebdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG os_vif [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96ecbd22-c1, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96ecbd22-c1, col_values=(('external_ids', {'iface-id': '96ecbd22-c121-40ce-8f58-9c14788d09fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:55:3d', 'vm-uuid': '693cc4d3-51fc-4d13-b5aa-832d22b1ebdd'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:47 user nova-compute[73007]: INFO os_vif [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1')
Aug 15 18:02:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:02:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No VIF found with MAC fa:16:3e:29:55:3d, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-3e0ea66e-ad09-40d1-8e3c-2b250ad25847 req-be2e150c-edf0-49e8-8962-c4ad6669902f service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3e0ea66e-ad09-40d1-8e3c-2b250ad25847 req-be2e150c-edf0-49e8-8962-c4ad6669902f service nova] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3e0ea66e-ad09-40d1-8e3c-2b250ad25847 req-be2e150c-edf0-49e8-8962-c4ad6669902f service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3e0ea66e-ad09-40d1-8e3c-2b250ad25847 req-be2e150c-edf0-49e8-8962-c4ad6669902f service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG nova.compute.manager [req-3e0ea66e-ad09-40d1-8e3c-2b250ad25847 req-be2e150c-edf0-49e8-8962-c4ad6669902f service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] No waiting events found dispatching network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:48 user nova-compute[73007]: WARNING nova.compute.manager [req-3e0ea66e-ad09-40d1-8e3c-2b250ad25847 req-be2e150c-edf0-49e8-8962-c4ad6669902f service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received unexpected event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb for instance with vm_state building and task_state spawning.
Aug 15 18:02:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122570.3801157, 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:02:50 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] VM Resumed (Lifecycle Event)
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:02:50 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance spawned successfully.
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:02:50 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122570.383153, 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:02:50 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] VM Started (Lifecycle Event)
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:02:50 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:02:50 user nova-compute[73007]: INFO nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:02:50 user nova-compute[73007]: INFO nova.compute.manager [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Took 15.62 seconds to build instance.
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-a835d794-966a-476a-9146-e9933d8f0252 req-fd1c5948-ca15-4140-b5f4-5b435550731e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a835d794-966a-476a-9146-e9933d8f0252 req-fd1c5948-ca15-4140-b5f4-5b435550731e service nova] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a835d794-966a-476a-9146-e9933d8f0252 req-fd1c5948-ca15-4140-b5f4-5b435550731e service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a835d794-966a-476a-9146-e9933d8f0252 req-fd1c5948-ca15-4140-b5f4-5b435550731e service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:50 user nova-compute[73007]: DEBUG nova.compute.manager [req-a835d794-966a-476a-9146-e9933d8f0252 req-fd1c5948-ca15-4140-b5f4-5b435550731e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] No waiting events found dispatching network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:02:50 user nova-compute[73007]: WARNING nova.compute.manager [req-a835d794-966a-476a-9146-e9933d8f0252 req-fd1c5948-ca15-4140-b5f4-5b435550731e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received unexpected event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb for instance with vm_state active and task_state None.
Aug 15 18:02:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-47346df2-3dee-498e-8d69-4d9948ba2f3d tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.723s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:02:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:02:59 user nova-compute[73007]: INFO nova.compute.manager [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Rescuing
Aug 15 18:02:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:02:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquired lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:02:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:02:59 user nova-compute[73007]: DEBUG nova.network.neutron [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Updating instance_info_cache with network_info: [{"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Releasing lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-a58c2476-730b-4e29-bacf-177825a952ee req-bf5d8008-8500-482f-9900-7f4ad2996880 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a58c2476-730b-4e29-bacf-177825a952ee req-bf5d8008-8500-482f-9900-7f4ad2996880 service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a58c2476-730b-4e29-bacf-177825a952ee req-bf5d8008-8500-482f-9900-7f4ad2996880 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a58c2476-730b-4e29-bacf-177825a952ee req-bf5d8008-8500-482f-9900-7f4ad2996880 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-a58c2476-730b-4e29-bacf-177825a952ee req-bf5d8008-8500-482f-9900-7f4ad2996880 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:00 user nova-compute[73007]: WARNING nova.compute.manager [req-a58c2476-730b-4e29-bacf-177825a952ee req-bf5d8008-8500-482f-9900-7f4ad2996880 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state active and task_state rescuing.
Aug 15 18:03:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance destroyed successfully.
Aug 15 18:03:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Attempting a stable device rescue
Aug 15 18:03:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73007) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance directory exists: not creating {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 18:03:00 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Creating image(s)
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "/opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "/opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "ee9610e96f059daef7232fecafc3bdd5c7fbfb20" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "ee9610e96f059daef7232fecafc3bdd5c7fbfb20" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20.part --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:01 user nova-compute[73007]: DEBUG nova.virt.images [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] 284fbdd3-35fb-4912-aa87-d58ac6d567ac was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 18:03:01 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 18:03:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20.part /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20.part /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20.converted" returned: 0 in 0.373s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-b9673cee-ca06-4402-bdb0-97dab629c683 req-c1dd57d5-a94f-41a1-8ac7-34cf3a854dda service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b9673cee-ca06-4402-bdb0-97dab629c683 req-c1dd57d5-a94f-41a1-8ac7-34cf3a854dda service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b9673cee-ca06-4402-bdb0-97dab629c683 req-c1dd57d5-a94f-41a1-8ac7-34cf3a854dda service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b9673cee-ca06-4402-bdb0-97dab629c683 req-c1dd57d5-a94f-41a1-8ac7-34cf3a854dda service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-b9673cee-ca06-4402-bdb0-97dab629c683 req-c1dd57d5-a94f-41a1-8ac7-34cf3a854dda service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:02 user nova-compute[73007]: WARNING nova.compute.manager [req-b9673cee-ca06-4402-bdb0-97dab629c683 req-c1dd57d5-a94f-41a1-8ac7-34cf3a854dda service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state active and task_state rescuing.
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "ee9610e96f059daef7232fecafc3bdd5c7fbfb20" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.878s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "ee9610e96f059daef7232fecafc3bdd5c7fbfb20" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "ee9610e96f059daef7232fecafc3bdd5c7fbfb20" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20 --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20,backing_fmt=raw /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20,backing_fmt=raw /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue" returned: 0 in 0.064s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "ee9610e96f059daef7232fecafc3bdd5c7fbfb20" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'migration_context' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Start _get_guest_xml network_info=[{"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "vif_mac": "fa:16:3e:8f:a4:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '284fbdd3-35fb-4912-aa87-d58ac6d567ac', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtzdoGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5d29f229-4024-4a0e-b18a-b7a79de8c583', 'attached_at': '', 'detached_at': '', 'volume_id': '0ce6b5aa-d6f5-4618-915c-3a87ba972f5b', 'serial': '0ce6b5aa-d6f5-4618-915c-3a87ba972f5b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '48635181-8da1-4068-b0b8-000115d4e0af', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'resources' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'numa_topology' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:02 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:03:02 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:03:02 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtzdoGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:03:03 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:03:03 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:03:03 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93ffda3-2dca-487b-8e66-5901993cd423]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WtzdoGHi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 18:03:03 user nova-compute[73007]: node.name = iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b
Aug 15 18:03:03 user nova-compute[73007]: node.tpgt = -1
Aug 15 18:03:03 user nova-compute[73007]: node.startup = automatic
Aug 15 18:03:03 user nova-compute[73007]: node.leading_login = No
Aug 15 18:03:03 user nova-compute[73007]: iface.iscsi_ifacename = default
Aug 15 18:03:03 user nova-compute[73007]: iface.net_ifacename = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.ipaddress = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.prefix_len = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.hwaddress = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.transport_name = tcp
Aug 15 18:03:03 user nova-compute[73007]: iface.initiatorname = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.state = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.vlan_id = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.vlan_priority = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.vlan_state = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.iface_num = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.mtu = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.port = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.bootproto = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.subnet_mask = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.gateway = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.dhcp_alt_client_id = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.dhcp_dns = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.dhcp_learn_iqn = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.dhcp_vendor_id_state = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.dhcp_vendor_id = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.dhcp_slp_da = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.fragmentation = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.gratuitous_arp = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.incoming_forwarding = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.tos_state = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.tos = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.ttl = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.delayed_ack = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.tcp_nagle = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.tcp_wsf_state = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.tcp_wsf = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.tcp_timer_scale = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.tcp_timestamp = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.redirect = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.def_task_mgmt_timeout = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.header_digest = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.data_digest = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.immediate_data = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.initial_r2t = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.data_seq_inorder = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.data_pdu_inorder = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.erl = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.max_receive_data_len = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.first_burst_len = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.max_outstanding_r2t = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.max_burst_len = 0
Aug 15 18:03:03 user nova-compute[73007]: iface.chap_auth = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.bidi_chap = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.strict_login_compliance = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.discovery_auth = <empty>
Aug 15 18:03:03 user nova-compute[73007]: iface.discovery_logout = <empty>
Aug 15 18:03:03 user nova-compute[73007]: node.discovery_address = <empty>
Aug 15 18:03:03 user nova-compute[73007]: node.discovery_port = 0
Aug 15 18:03:03 user nova-compute[73007]: node.discovery_type = static
Aug 15 18:03:03 user nova-compute[73007]: node.session.initial_cmdsn = 0
Aug 15 18:03:03 user nova-compute[73007]: node.session.initial_login_retry_max = 8
Aug 15 18:03:03 user nova-compute[73007]: node.session.xmit_thread_priority = -20
Aug 15 18:03:03 user nova-compute[73007]: node.session.cmds_max = 128
Aug 15 18:03:03 user nova-compute[73007]: node.session.queue_depth = 32
Aug 15 18:03:03 user nova-compute[73007]: node.session.nr_sessions = 1
Aug 15 18:03:03 user nova-compute[73007]: node.session.auth.authmethod = CHAP
Aug 15 18:03:03 user nova-compute[73007]: node.session.auth.username = WtzdoGHi
Aug 15 18:03:03 user nova-compute[73007]: node.session.auth.password = ***
Aug 15 18:03:03 user nova-compute[73007]: node.session.auth.username_in = <empty>
Aug 15 18:03:03 user nova-compute[73007]: node.session.auth.password_in = <empty>
Aug 15 18:03:03 user nova-compute[73007]: node.session.auth.chap_algs = MD5
Aug 15 18:03:03 user nova-compute[73007]: node.session.timeo.replacement_timeout = 120
Aug 15 18:03:03 user nova-compute[73007]: node.session.err_timeo.abort_timeout = 15
Aug 15 18:03:03 user nova-compute[73007]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 18:03:03 user nova-compute[73007]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 18:03:03 user nova-compute[73007]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.FastAbort = Yes
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.InitialR2T = No
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.ImmediateData = Yes
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.MaxConnections = 1
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 18:03:03 user nova-compute[73007]: node.session.iscsi.ERL = 0
Aug 15 18:03:03 user nova-compute[73007]: node.session.scan = manual
Aug 15 18:03:03 user nova-compute[73007]: node.session.reopen_max = 0
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].address = 172.16.0.220
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].port = 3260
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].startup = manual
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].tcp.window_size = 524288
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].tcp.type_of_service = 0
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].timeo.logout_timeout = 15
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].timeo.login_timeout = 15
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].timeo.auth_timeout = 45
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].iscsi.DataDigest = None
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].iscsi.IFMarker = No
Aug 15 18:03:03 user nova-compute[73007]: node.conn[0].iscsi.OFMarker = No
Aug 15 18:03:03 user nova-compute[73007]: # END RECORD
Aug 15 18:03:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[178fc5b5-eaf0-4ace-a151-01571c04c145]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a958f870-c12c-4344-843b-b7a710a2e254]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtzdoGHi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtzdoGHi" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c660b8ea-d8af-4d80-bd0c-7234728995d7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WtzdoGHi'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9caaf2-99b8-4a35-b048-b019fa47a8ec]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9af47a-e3c9-4664-82c6-ebc26568a833]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:03:03 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:03:03 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:03:03 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:03:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:03:03 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:03:03 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:03:03 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:03:03 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] HCTL ('35', '0', '0', 0) found on session 46 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f6933c-3a85-4bcb-9ed0-3858859c297f]: (4, ('0 0 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Searching for a device in session 46 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtzdoGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '23866326431346530', 'path': '/dev/sdd'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866326431346530', 'path': '/dev/sdd'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-329861494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-329861494',id=40,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-tw4g3u07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:01:40Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=5d29f229-4024-4a0e-b18a-b7a79de8c583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "vif_mac": "fa:16:3e:8f:a4:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "vif_mac": "fa:16:3e:8f:a4:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=1f852c51-0895-4cf3-8fd9-a5b266f8166b,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f852c51-08') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:03:03 user nova-compute[73007]:   <uuid>5d29f229-4024-4a0e-b18a-b7a79de8c583</uuid>
Aug 15 18:03:03 user nova-compute[73007]:   <name>instance-00000028</name>
Aug 15 18:03:03 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:03:03 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:03:03 user nova-compute[73007]:   <metadata>
Aug 15 18:03:03 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:03:03 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:03:03 user nova-compute[73007]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-329861494</nova:name>
Aug 15 18:03:03 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:03:02</nova:creationTime>
Aug 15 18:03:03 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:03:03 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:03:03 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:03:03 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:03:03 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:03:03 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:03:03 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:03:03 user nova-compute[73007]:       <nova:owner>
Aug 15 18:03:03 user nova-compute[73007]:         <nova:user uuid="2b7b5264253d44e9a51d06f66bed1443">tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member</nova:user>
Aug 15 18:03:03 user nova-compute[73007]:         <nova:project uuid="6e88231a35bb4a2e8b5e1e7d5e5f9418">tempest-ServerBootFromVolumeStableRescueTest-452961283</nova:project>
Aug 15 18:03:03 user nova-compute[73007]:       </nova:owner>
Aug 15 18:03:03 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:03:03 user nova-compute[73007]:       <nova:ports>
Aug 15 18:03:03 user nova-compute[73007]:         <nova:port uuid="1f852c51-0895-4cf3-8fd9-a5b266f8166b">
Aug 15 18:03:03 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 18:03:03 user nova-compute[73007]:         </nova:port>
Aug 15 18:03:03 user nova-compute[73007]:       </nova:ports>
Aug 15 18:03:03 user nova-compute[73007]:     </nova:instance>
Aug 15 18:03:03 user nova-compute[73007]:   </metadata>
Aug 15 18:03:03 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:03:03 user nova-compute[73007]:     <system>
Aug 15 18:03:03 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:03:03 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:03:03 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:03:03 user nova-compute[73007]:       <entry name="serial">5d29f229-4024-4a0e-b18a-b7a79de8c583</entry>
Aug 15 18:03:03 user nova-compute[73007]:       <entry name="uuid">5d29f229-4024-4a0e-b18a-b7a79de8c583</entry>
Aug 15 18:03:03 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:03:03 user nova-compute[73007]:     </system>
Aug 15 18:03:03 user nova-compute[73007]:   </sysinfo>
Aug 15 18:03:03 user nova-compute[73007]:   <os>
Aug 15 18:03:03 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:03:03 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:03:03 user nova-compute[73007]:   </os>
Aug 15 18:03:03 user nova-compute[73007]:   <features>
Aug 15 18:03:03 user nova-compute[73007]:     <acpi/>
Aug 15 18:03:03 user nova-compute[73007]:     <apic/>
Aug 15 18:03:03 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:03:03 user nova-compute[73007]:   </features>
Aug 15 18:03:03 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:03:03 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:03:03 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:03:03 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:03:03 user nova-compute[73007]:   </clock>
Aug 15 18:03:03 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:03:03 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:03:03 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:03:03 user nova-compute[73007]:   </cpu>
Aug 15 18:03:03 user nova-compute[73007]:   <devices>
Aug 15 18:03:03 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:03:03 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:03:03 user nova-compute[73007]:       <source dev="/dev/sdd"/>
Aug 15 18:03:03 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:03:03 user nova-compute[73007]:       <serial>0ce6b5aa-d6f5-4618-915c-3a87ba972f5b</serial>
Aug 15 18:03:03 user nova-compute[73007]:     </disk>
Aug 15 18:03:03 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:03:03 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:03:03 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue"/>
Aug 15 18:03:03 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 18:03:03 user nova-compute[73007]:       <boot order="1"/>
Aug 15 18:03:03 user nova-compute[73007]:     </disk>
Aug 15 18:03:03 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:03:03 user nova-compute[73007]:       <mac address="fa:16:3e:8f:a4:96"/>
Aug 15 18:03:03 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:03:03 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:03:03 user nova-compute[73007]:       <target dev="tap1f852c51-08"/>
Aug 15 18:03:03 user nova-compute[73007]:     </interface>
Aug 15 18:03:03 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:03:03 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/console.log" append="off"/>
Aug 15 18:03:03 user nova-compute[73007]:     </serial>
Aug 15 18:03:03 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:03:03 user nova-compute[73007]:     <video>
Aug 15 18:03:03 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:03:03 user nova-compute[73007]:     </video>
Aug 15 18:03:03 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:03:03 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:03:03 user nova-compute[73007]:     </rng>
Aug 15 18:03:03 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:03:03 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:03:03 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:03:03 user nova-compute[73007]:     </memballoon>
Aug 15 18:03:03 user nova-compute[73007]:   </devices>
Aug 15 18:03:03 user nova-compute[73007]: </domain>
Aug 15 18:03:03 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:03:03 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance destroyed successfully.
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:03:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] No VIF found with MAC fa:16:3e:8f:a4:96, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-181901ad-da6c-4e82-80fd-f0e81d9c8a6f req-7534cc94-9ea7-4f07-840b-9b785eb0ae77 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-181901ad-da6c-4e82-80fd-f0e81d9c8a6f req-7534cc94-9ea7-4f07-840b-9b785eb0ae77 service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-181901ad-da6c-4e82-80fd-f0e81d9c8a6f req-7534cc94-9ea7-4f07-840b-9b785eb0ae77 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-181901ad-da6c-4e82-80fd-f0e81d9c8a6f req-7534cc94-9ea7-4f07-840b-9b785eb0ae77 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG nova.compute.manager [req-181901ad-da6c-4e82-80fd-f0e81d9c8a6f req-7534cc94-9ea7-4f07-840b-9b785eb0ae77 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:04 user nova-compute[73007]: WARNING nova.compute.manager [req-181901ad-da6c-4e82-80fd-f0e81d9c8a6f req-7534cc94-9ea7-4f07-840b-9b785eb0ae77 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state active and task_state rescuing.
Aug 15 18:03:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for 5d29f229-4024-4a0e-b18a-b7a79de8c583 due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122586.7341747, 5d29f229-4024-4a0e-b18a-b7a79de8c583 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:03:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] VM Resumed (Lifecycle Event)
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7899adca-89f6-467d-a88f-00b336fdc60b tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:03:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122586.7375975, 5d29f229-4024-4a0e-b18a-b7a79de8c583 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:03:06 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] VM Started (Lifecycle Event)
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-ac565b24-a293-4e7b-aa94-a2d06c803faf req-cc1b96f0-5df0-4e2d-8018-8b2ce447224c service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ac565b24-a293-4e7b-aa94-a2d06c803faf req-cc1b96f0-5df0-4e2d-8018-8b2ce447224c service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ac565b24-a293-4e7b-aa94-a2d06c803faf req-cc1b96f0-5df0-4e2d-8018-8b2ce447224c service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ac565b24-a293-4e7b-aa94-a2d06c803faf req-cc1b96f0-5df0-4e2d-8018-8b2ce447224c service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-ac565b24-a293-4e7b-aa94-a2d06c803faf req-cc1b96f0-5df0-4e2d-8018-8b2ce447224c service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:06 user nova-compute[73007]: WARNING nova.compute.manager [req-ac565b24-a293-4e7b-aa94-a2d06c803faf req-cc1b96f0-5df0-4e2d-8018-8b2ce447224c service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state rescued and task_state None.
Aug 15 18:03:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "e80a756d-ec14-417e-8164-a1e9db7041d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:03:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:08 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:03:08 user nova-compute[73007]: INFO nova.compute.claims [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Claim successful on node user
Aug 15 18:03:09 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:03:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:03:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:03:09 user nova-compute[73007]: INFO nova.virt.block_device [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Booting with volume 2681b1cb-b2a5-412b-b8bc-e631cb3b537b at /dev/vda
Aug 15 18:03:09 user nova-compute[73007]: DEBUG nova.policy [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cd910b3e8bf406f8512b3470f6eaca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eebca3ef0a45788b0dfbc03b01fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG os_brick.utils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0d8c34-26e2-4f53-8080-1adb49f40fe0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[453a9648-bcc6-4498-8549-b8eba27525ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[738a9b09-5278-4986-a443-a80f9b0dcc5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c927f2-0e08-4317-ab41-788a7397b68b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:03:09 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:03:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a9f465-d185-4e5d-a71c-16d571c94abd]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG os_brick.utils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:03:09 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updating existing volume attachment record: 8d7bf391-6958-46fe-bdcc-f1012d7b0783 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:03:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Successfully created port: 3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Successfully updated port: 3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquired lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-e1745570-c771-4069-b85a-e52f14cad925 req-b36c41c4-8ae1-4827-98e8-97c9ea214865 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-changed-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-e1745570-c771-4069-b85a-e52f14cad925 req-b36c41c4-8ae1-4827-98e8-97c9ea214865 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Refreshing instance network info cache due to event network-changed-3e388fd1-eeef-4853-b992-91c420a3c694. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e1745570-c771-4069-b85a-e52f14cad925 req-b36c41c4-8ae1-4827-98e8-97c9ea214865 service nova] Acquiring lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updating instance_info_cache with network_info: [{"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Releasing lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Instance network_info: |[{"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e1745570-c771-4069-b85a-e52f14cad925 req-b36c41c4-8ae1-4827-98e8-97c9ea214865 service nova] Acquired lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:03:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-e1745570-c771-4069-b85a-e52f14cad925 req-b36c41c4-8ae1-4827-98e8-97c9ea214865 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Refreshing network info cache for port 3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating instance_info_cache with network_info: [{"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-029c5519-9937-439c-9fc7-f1bad76d26f9" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-e1745570-c771-4069-b85a-e52f14cad925 req-b36c41c4-8ae1-4827-98e8-97c9ea214865 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updated VIF entry in instance network info cache for port 3e388fd1-eeef-4853-b992-91c420a3c694. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-e1745570-c771-4069-b85a-e52f14cad925 req-b36c41c4-8ae1-4827-98e8-97c9ea214865 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updating instance_info_cache with network_info: [{"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:03:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e1745570-c771-4069-b85a-e52f14cad925 req-b36c41c4-8ae1-4827-98e8-97c9ea214865 service nova] Releasing lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:18 user nova-compute[73007]: INFO nova.compute.manager [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] instance snapshotting
Aug 15 18:03:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Beginning live snapshot process
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json -f qcow2 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json -f qcow2 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpntx64xnf/068538ec8a3f4562956c2cb59f19a264.delta 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpntx64xnf/068538ec8a3f4562956c2cb59f19a264.delta 1073741824" returned: 0 in 0.052s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 18:03:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73007) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 18:03:21 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:03:21 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7093MB free_disk=24.865478515625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:21 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpntx64xnf/068538ec8a3f4562956c2cb59f19a264.delta /opt/stack/data/nova/instances/snapshots/tmpntx64xnf/068538ec8a3f4562956c2cb59f19a264 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 029c5519-9937-439c-9fc7-f1bad76d26f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance da287ce9-0600-43be-94aa-038eb1edaf07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5d29f229-4024-4a0e-b18a-b7a79de8c583 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6545b6a7-4c0e-4d97-8c98-7491292c566a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 0678e5e5-d3d8-43f0-937d-e367bd94329a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e80a756d-ec14-417e-8164-a1e9db7041d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:03:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:03:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpntx64xnf/068538ec8a3f4562956c2cb59f19a264.delta /opt/stack/data/nova/instances/snapshots/tmpntx64xnf/068538ec8a3f4562956c2cb59f19a264" returned: 0 in 0.510s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:22 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Snapshot extracted, beginning image upload
Aug 15 18:03:22 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:03:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:03:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:03:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.957s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:03:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:03:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Snapshot image upload complete
Aug 15 18:03:24 user nova-compute[73007]: INFO nova.compute.manager [None req-6847b216-2ea4-4c60-8cc2-95d4f3e85d0d tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Took 5.60 seconds to snapshot the instance on the hypervisor.
Aug 15 18:03:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:03:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:03:26 user nova-compute[73007]: INFO nova.compute.claims [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Claim successful on node user
Aug 15 18:03:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.875s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:03:27 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:03:27 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Creating image(s)
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Ensure instance console log exists: /opt/stack/data/nova/instances/e80a756d-ec14-417e-8164-a1e9db7041d8/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Start _get_guest_xml network_info=[{"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtHngFJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e80a756d-ec14-417e-8164-a1e9db7041d8', 'attached_at': '', 'detached_at': '', 'volume_id': '2681b1cb-b2a5-412b-b8bc-e631cb3b537b', 'serial': '2681b1cb-b2a5-412b-b8bc-e631cb3b537b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '8d7bf391-6958-46fe-bdcc-f1012d7b0783', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:03:27 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:03:27 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.policy [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a4ecddd550e412e83798beb94d71db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9dc4bf210044c769da4afeb6fbb7607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtHngFJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:03:27 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:03:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:03:27 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:03:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:03:27 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:03:27 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Creating image(s)
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "/opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "/opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "/opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "b098ee6fb673df576dcc93bf6f0ded1f7d7e835e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "b098ee6fb673df576dcc93bf6f0ded1f7d7e835e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4e2a1b-7c94-414f-bc6b-6222da16d036]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:03:27 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4a9eef-b897-4194-a748-41309914eec1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b] added
Aug 15 18:03:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e862ab-082f-48be-ab53-2111a903cb4c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58793ea-3c20-4d5a-9950-1605ccb2abe8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Successfully created port: 34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtHngFJw {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtHngFJw" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[03565c53-de67-47a7-9a12-42d981190f3e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PtHngFJw'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb27caa-9af7-4b93-9dac-cd3b13a49c2f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed9ed43-b457-4a8a-a655-ed4c2bf3b0bc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:03:28 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:03:28 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:03:28 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:03:28 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:03:28 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:03:28 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:03:28 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:03:28 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e.part --force-share --output=json" returned: 0 in 0.173s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG nova.virt.images [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] 4e1dd7ec-f424-4ee6-9cb7-1c63f425a7df was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 18:03:28 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e.part /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ed0c96-10bc-4664-850c-98fd8aef4008]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260]
Aug 15 18:03:29 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260] successful.
Aug 15 18:03:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f64559-f64b-430a-bda1-cbf5c804c59b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[de750df6-894e-4eb4-8ffb-1293822823c6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:03:29 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:03:29 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:03:29 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:03:29 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:03:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:03:29 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:03:29 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:03:29 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:03:29 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:03:29 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] HCTL ('37', '-', '-', 0) found on session 51 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.057s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec30c82-7dd5-42e3-9971-dadfd9f8f7a0]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e.part /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e.converted" returned: 0 in 0.327s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "b098ee6fb673df576dcc93bf6f0ded1f7d7e835e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.601s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Successfully updated port: 34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "b098ee6fb673df576dcc93bf6f0ded1f7d7e835e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "b098ee6fb673df576dcc93bf6f0ded1f7d7e835e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquired lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-28e56063-2279-48e9-8aad-30906f4613f8 req-7e461c87-9a2a-41db-a800-bb59cee39a6c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received event network-changed-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-28e56063-2279-48e9-8aad-30906f4613f8 req-7e461c87-9a2a-41db-a800-bb59cee39a6c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Refreshing instance network info cache due to event network-changed-34509f5f-93dd-4ba2-beac-4d1466dd853b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-28e56063-2279-48e9-8aad-30906f4613f8 req-7e461c87-9a2a-41db-a800-bb59cee39a6c service nova] Acquiring lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e,backing_fmt=raw /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e,backing_fmt=raw /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk 1073741824" returned: 0 in 0.051s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "b098ee6fb673df576dcc93bf6f0ded1f7d7e835e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:29 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'migration_context' on Instance uuid 51963042-c0c7-4cda-8700-3de6115b9e09 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Ensure instance console log exists: /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 51 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtHngFJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.255s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== connect_volume: return (2256ms) {'type': 'block', 'scsi_wwn': '26130663632613865', 'path': '/dev/sdf'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130663632613865', 'path': '/dev/sdf'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updating instance_info_cache with network_info: [{"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Releasing lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Instance network_info: |[{"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-28e56063-2279-48e9-8aad-30906f4613f8 req-7e461c87-9a2a-41db-a800-bb59cee39a6c service nova] Acquired lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.neutron [req-28e56063-2279-48e9-8aad-30906f4613f8 req-7e461c87-9a2a-41db-a800-bb59cee39a6c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Refreshing network info cache for port 34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Start _get_guest_xml network_info=[{"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5c2529aae9045e671e49e64dc782eea3',container_format='bare',created_at=2023-08-15T18:03:19Z,direct_url=<?>,disk_format='qcow2',id=4e1dd7ec-f424-4ee6-9cb7-1c63f425a7df,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1756957577',owner='f9dc4bf210044c769da4afeb6fbb7607',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T18:03:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '4e1dd7ec-f424-4ee6-9cb7-1c63f425a7df'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-78066264',display_name='tempest-TestVolumeBootPattern-server-78066264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-78066264',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-j0ld6lg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:03:10Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=e80a756d-ec14-417e-8164-a1e9db7041d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:54:a6,bridge_name='br-int',has_traffic_filtering=True,id=3e388fd1-eeef-4853-b992-91c420a3c694,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e388fd1-ee') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'pci_devices' on Instance uuid e80a756d-ec14-417e-8164-a1e9db7041d8 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:03:30 user nova-compute[73007]:   <uuid>e80a756d-ec14-417e-8164-a1e9db7041d8</uuid>
Aug 15 18:03:30 user nova-compute[73007]:   <name>instance-0000002c</name>
Aug 15 18:03:30 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:03:30 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:03:30 user nova-compute[73007]:   <metadata>
Aug 15 18:03:30 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:03:30 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:name>tempest-TestVolumeBootPattern-server-78066264</nova:name>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:03:27</nova:creationTime>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:03:30 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:03:30 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:owner>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:user uuid="4cd910b3e8bf406f8512b3470f6eaca5">tempest-TestVolumeBootPattern-393609756-project-member</nova:user>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:project uuid="c6eebca3ef0a45788b0dfbc03b01fe8c">tempest-TestVolumeBootPattern-393609756</nova:project>
Aug 15 18:03:30 user nova-compute[73007]:       </nova:owner>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:ports>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:port uuid="3e388fd1-eeef-4853-b992-91c420a3c694">
Aug 15 18:03:30 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 18:03:30 user nova-compute[73007]:         </nova:port>
Aug 15 18:03:30 user nova-compute[73007]:       </nova:ports>
Aug 15 18:03:30 user nova-compute[73007]:     </nova:instance>
Aug 15 18:03:30 user nova-compute[73007]:   </metadata>
Aug 15 18:03:30 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:03:30 user nova-compute[73007]:     <system>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="serial">e80a756d-ec14-417e-8164-a1e9db7041d8</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="uuid">e80a756d-ec14-417e-8164-a1e9db7041d8</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:03:30 user nova-compute[73007]:     </system>
Aug 15 18:03:30 user nova-compute[73007]:   </sysinfo>
Aug 15 18:03:30 user nova-compute[73007]:   <os>
Aug 15 18:03:30 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:03:30 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:03:30 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:03:30 user nova-compute[73007]:   </os>
Aug 15 18:03:30 user nova-compute[73007]:   <features>
Aug 15 18:03:30 user nova-compute[73007]:     <acpi/>
Aug 15 18:03:30 user nova-compute[73007]:     <apic/>
Aug 15 18:03:30 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:03:30 user nova-compute[73007]:   </features>
Aug 15 18:03:30 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:03:30 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:03:30 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:03:30 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:03:30 user nova-compute[73007]:   </clock>
Aug 15 18:03:30 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:03:30 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:03:30 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:03:30 user nova-compute[73007]:   </cpu>
Aug 15 18:03:30 user nova-compute[73007]:   <devices>
Aug 15 18:03:30 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:03:30 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:03:30 user nova-compute[73007]:       <source dev="/dev/sdf"/>
Aug 15 18:03:30 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:03:30 user nova-compute[73007]:       <serial>2681b1cb-b2a5-412b-b8bc-e631cb3b537b</serial>
Aug 15 18:03:30 user nova-compute[73007]:     </disk>
Aug 15 18:03:30 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:03:30 user nova-compute[73007]:       <mac address="fa:16:3e:7d:54:a6"/>
Aug 15 18:03:30 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:03:30 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:03:30 user nova-compute[73007]:       <target dev="tap3e388fd1-ee"/>
Aug 15 18:03:30 user nova-compute[73007]:     </interface>
Aug 15 18:03:30 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:03:30 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/e80a756d-ec14-417e-8164-a1e9db7041d8/console.log" append="off"/>
Aug 15 18:03:30 user nova-compute[73007]:     </serial>
Aug 15 18:03:30 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:03:30 user nova-compute[73007]:     <video>
Aug 15 18:03:30 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:03:30 user nova-compute[73007]:     </video>
Aug 15 18:03:30 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:03:30 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:03:30 user nova-compute[73007]:     </rng>
Aug 15 18:03:30 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:03:30 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:03:30 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:03:30 user nova-compute[73007]:     </memballoon>
Aug 15 18:03:30 user nova-compute[73007]:   </devices>
Aug 15 18:03:30 user nova-compute[73007]: </domain>
Aug 15 18:03:30 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-78066264',display_name='tempest-TestVolumeBootPattern-server-78066264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-78066264',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-j0ld6lg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:03:10Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=e80a756d-ec14-417e-8164-a1e9db7041d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:54:a6,bridge_name='br-int',has_traffic_filtering=True,id=3e388fd1-eeef-4853-b992-91c420a3c694,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e388fd1-ee') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG os_vif [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:54:a6,bridge_name='br-int',has_traffic_filtering=True,id=3e388fd1-eeef-4853-b992-91c420a3c694,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e388fd1-ee') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:03:30 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:03:30 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e388fd1-ee, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e388fd1-ee, col_values=(('external_ids', {'iface-id': '3e388fd1-eeef-4853-b992-91c420a3c694', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:54:a6', 'vm-uuid': 'e80a756d-ec14-417e-8164-a1e9db7041d8'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:30 user nova-compute[73007]: INFO os_vif [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:54:a6,bridge_name='br-int',has_traffic_filtering=True,id=3e388fd1-eeef-4853-b992-91c420a3c694,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e388fd1-ee')
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5c2529aae9045e671e49e64dc782eea3',container_format='bare',created_at=2023-08-15T18:03:19Z,direct_url=<?>,disk_format='qcow2',id=4e1dd7ec-f424-4ee6-9cb7-1c63f425a7df,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1756957577',owner='f9dc4bf210044c769da4afeb6fbb7607',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T18:03:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-711461211',display_name='tempest-TestStampPattern-server-711461211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-711461211',id=45,image_ref='4e1dd7ec-f424-4ee6-9cb7-1c63f425a7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Wzpkb4d/FqkLpOgMs40DkQZ4S3W/bdhb1IceHH+6YDRcBBgEJz/OwRQD9/KRHQQ/5ClKqrnorBoWo+ErrhtxAJD56iE9sp7wIWJnjhB08h2DT6wHTAeyjVek0+ZKfdQ==',key_name='tempest-TestStampPattern-319626008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9dc4bf210044c769da4afeb6fbb7607',ramdisk_id='',reservation_id='r-pdurinkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5ed0a68e-b82d-4aa9-b7d6-01aaa573c541',image_min_disk='1',image_min_ram='0',image_owner_id='f9dc4bf210044c769da4afeb6fbb7607',image_owner_project_name='tempest-TestStampPattern-1140446429',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1140446429-project-member',image_user_id='0a4ecddd550e412e83798beb94d71db6',network_allocated='True',owner_project_name='tempest-TestStampPattern-1140446429',owner_user_name='tempest-TestStampPattern-1140446429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:03:28Z,user_data=None,user_id='0a4ecddd550e412e83798beb94d71db6',uuid=51963042-c0c7-4cda-8700-3de6115b9e09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converting VIF {"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:38:5b,bridge_name='br-int',has_traffic_filtering=True,id=34509f5f-93dd-4ba2-beac-4d1466dd853b,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34509f5f-93') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'pci_devices' on Instance uuid 51963042-c0c7-4cda-8700-3de6115b9e09 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:03:30 user nova-compute[73007]:   <uuid>51963042-c0c7-4cda-8700-3de6115b9e09</uuid>
Aug 15 18:03:30 user nova-compute[73007]:   <name>instance-0000002d</name>
Aug 15 18:03:30 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:03:30 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:03:30 user nova-compute[73007]:   <metadata>
Aug 15 18:03:30 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:03:30 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:name>tempest-TestStampPattern-server-711461211</nova:name>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:03:30</nova:creationTime>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:03:30 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:03:30 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:owner>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:user uuid="0a4ecddd550e412e83798beb94d71db6">tempest-TestStampPattern-1140446429-project-member</nova:user>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:project uuid="f9dc4bf210044c769da4afeb6fbb7607">tempest-TestStampPattern-1140446429</nova:project>
Aug 15 18:03:30 user nova-compute[73007]:       </nova:owner>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:root type="image" uuid="4e1dd7ec-f424-4ee6-9cb7-1c63f425a7df"/>
Aug 15 18:03:30 user nova-compute[73007]:       <nova:ports>
Aug 15 18:03:30 user nova-compute[73007]:         <nova:port uuid="34509f5f-93dd-4ba2-beac-4d1466dd853b">
Aug 15 18:03:30 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 18:03:30 user nova-compute[73007]:         </nova:port>
Aug 15 18:03:30 user nova-compute[73007]:       </nova:ports>
Aug 15 18:03:30 user nova-compute[73007]:     </nova:instance>
Aug 15 18:03:30 user nova-compute[73007]:   </metadata>
Aug 15 18:03:30 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:03:30 user nova-compute[73007]:     <system>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="serial">51963042-c0c7-4cda-8700-3de6115b9e09</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="uuid">51963042-c0c7-4cda-8700-3de6115b9e09</entry>
Aug 15 18:03:30 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:03:30 user nova-compute[73007]:     </system>
Aug 15 18:03:30 user nova-compute[73007]:   </sysinfo>
Aug 15 18:03:30 user nova-compute[73007]:   <os>
Aug 15 18:03:30 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:03:30 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:03:30 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:03:30 user nova-compute[73007]:   </os>
Aug 15 18:03:30 user nova-compute[73007]:   <features>
Aug 15 18:03:30 user nova-compute[73007]:     <acpi/>
Aug 15 18:03:30 user nova-compute[73007]:     <apic/>
Aug 15 18:03:30 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:03:30 user nova-compute[73007]:   </features>
Aug 15 18:03:30 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:03:30 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:03:30 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:03:30 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:03:30 user nova-compute[73007]:   </clock>
Aug 15 18:03:30 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:03:30 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:03:30 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:03:30 user nova-compute[73007]:   </cpu>
Aug 15 18:03:30 user nova-compute[73007]:   <devices>
Aug 15 18:03:30 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:03:30 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:03:30 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk"/>
Aug 15 18:03:30 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:03:30 user nova-compute[73007]:     </disk>
Aug 15 18:03:30 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:03:30 user nova-compute[73007]:       <mac address="fa:16:3e:f9:38:5b"/>
Aug 15 18:03:30 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:03:30 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:03:30 user nova-compute[73007]:       <target dev="tap34509f5f-93"/>
Aug 15 18:03:30 user nova-compute[73007]:     </interface>
Aug 15 18:03:30 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:03:30 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/console.log" append="off"/>
Aug 15 18:03:30 user nova-compute[73007]:     </serial>
Aug 15 18:03:30 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:03:30 user nova-compute[73007]:     <video>
Aug 15 18:03:30 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:03:30 user nova-compute[73007]:     </video>
Aug 15 18:03:30 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:03:30 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:03:30 user nova-compute[73007]:     </rng>
Aug 15 18:03:30 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:03:30 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:03:30 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:03:30 user nova-compute[73007]:     </memballoon>
Aug 15 18:03:30 user nova-compute[73007]:   </devices>
Aug 15 18:03:30 user nova-compute[73007]: </domain>
Aug 15 18:03:30 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-711461211',display_name='tempest-TestStampPattern-server-711461211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-711461211',id=45,image_ref='4e1dd7ec-f424-4ee6-9cb7-1c63f425a7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Wzpkb4d/FqkLpOgMs40DkQZ4S3W/bdhb1IceHH+6YDRcBBgEJz/OwRQD9/KRHQQ/5ClKqrnorBoWo+ErrhtxAJD56iE9sp7wIWJnjhB08h2DT6wHTAeyjVek0+ZKfdQ==',key_name='tempest-TestStampPattern-319626008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9dc4bf210044c769da4afeb6fbb7607',ramdisk_id='',reservation_id='r-pdurinkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5ed0a68e-b82d-4aa9-b7d6-01aaa573c541',image_min_disk='1',image_min_ram='0',image_owner_id='f9dc4bf210044c769da4afeb6fbb7607',image_owner_project_name='tempest-TestStampPattern-1140446429',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1140446429-project-member',image_user_id='0a4ecddd550e412e83798beb94d71db6',network_allocated='True',owner_project_name='tempest-TestStampPattern-1140446429',owner_user_name='tempest-TestStampPattern-1140446429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:03:28Z,user_data=None,user_id='0a4ecddd550e412e83798beb94d71db6',uuid=51963042-c0c7-4cda-8700-3de6115b9e09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converting VIF {"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:38:5b,bridge_name='br-int',has_traffic_filtering=True,id=34509f5f-93dd-4ba2-beac-4d1466dd853b,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34509f5f-93') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG os_vif [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:38:5b,bridge_name='br-int',has_traffic_filtering=True,id=34509f5f-93dd-4ba2-beac-4d1466dd853b,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34509f5f-93') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34509f5f-93, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34509f5f-93, col_values=(('external_ids', {'iface-id': '34509f5f-93dd-4ba2-beac-4d1466dd853b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:38:5b', 'vm-uuid': '51963042-c0c7-4cda-8700-3de6115b9e09'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:30 user nova-compute[73007]: INFO os_vif [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:38:5b,bridge_name='br-int',has_traffic_filtering=True,id=34509f5f-93dd-4ba2-beac-4d1466dd853b,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34509f5f-93')
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No VIF found with MAC fa:16:3e:7d:54:a6, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No VIF found with MAC fa:16:3e:f9:38:5b, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.neutron [req-28e56063-2279-48e9-8aad-30906f4613f8 req-7e461c87-9a2a-41db-a800-bb59cee39a6c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updated VIF entry in instance network info cache for port 34509f5f-93dd-4ba2-beac-4d1466dd853b. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG nova.network.neutron [req-28e56063-2279-48e9-8aad-30906f4613f8 req-7e461c87-9a2a-41db-a800-bb59cee39a6c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updating instance_info_cache with network_info: [{"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:03:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-28e56063-2279-48e9-8aad-30906f4613f8 req-7e461c87-9a2a-41db-a800-bb59cee39a6c service nova] Releasing lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-5bc7eb38-eeac-44fa-afe1-5f9bd52df7f1 req-3e61ed89-5ad1-45d8-86bc-fc2638a1dae1 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received event network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5bc7eb38-eeac-44fa-afe1-5f9bd52df7f1 req-3e61ed89-5ad1-45d8-86bc-fc2638a1dae1 service nova] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5bc7eb38-eeac-44fa-afe1-5f9bd52df7f1 req-3e61ed89-5ad1-45d8-86bc-fc2638a1dae1 service nova] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5bc7eb38-eeac-44fa-afe1-5f9bd52df7f1 req-3e61ed89-5ad1-45d8-86bc-fc2638a1dae1 service nova] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-5bc7eb38-eeac-44fa-afe1-5f9bd52df7f1 req-3e61ed89-5ad1-45d8-86bc-fc2638a1dae1 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] No waiting events found dispatching network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:32 user nova-compute[73007]: WARNING nova.compute.manager [req-5bc7eb38-eeac-44fa-afe1-5f9bd52df7f1 req-3e61ed89-5ad1-45d8-86bc-fc2638a1dae1 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received unexpected event network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b for instance with vm_state building and task_state spawning.
Aug 15 18:03:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received event network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] No waiting events found dispatching network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:34 user nova-compute[73007]: WARNING nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received unexpected event network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b for instance with vm_state building and task_state spawning.
Aug 15 18:03:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Acquiring lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] No waiting events found dispatching network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:34 user nova-compute[73007]: WARNING nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received unexpected event network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 for instance with vm_state building and task_state spawning.
Aug 15 18:03:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Acquiring lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] No waiting events found dispatching network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:34 user nova-compute[73007]: WARNING nova.compute.manager [req-0e7666ac-f480-412c-a1c0-faa951e0acb7 req-cdbb98db-d104-40d4-b34a-7282e31fb826 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received unexpected event network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 for instance with vm_state building and task_state spawning.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122615.5168748, 51963042-c0c7-4cda-8700-3de6115b9e09 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] VM Resumed (Lifecycle Event)
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Instance spawned successfully.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122615.5253394, 51963042-c0c7-4cda-8700-3de6115b9e09 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] VM Started (Lifecycle Event)
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Took 7.70 seconds to spawn the instance on the hypervisor.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122615.652041, e80a756d-ec14-417e-8164-a1e9db7041d8 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] VM Resumed (Lifecycle Event)
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Instance spawned successfully.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Took 8.95 seconds to build instance.
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122615.65355, e80a756d-ec14-417e-8164-a1e9db7041d8 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] VM Started (Lifecycle Event)
Aug 15 18:03:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8c13f1e6-d6ce-46fc-a389-16411fbf07db tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.054s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Took 7.95 seconds to spawn the instance on the hypervisor.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:03:35 user nova-compute[73007]: INFO nova.compute.manager [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Took 27.35 seconds to build instance.
Aug 15 18:03:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b486925-94c6-40ac-b242-863469428893 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.453s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'flavor' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:41 user nova-compute[73007]: INFO nova.compute.manager [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Attaching volume 19dffe87-082a-483f-96c0-a21015468766 to /dev/vdb
Aug 15 18:03:41 user nova-compute[73007]: DEBUG os_brick.utils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52d63f8-be4b-4994-86cb-674cb77eb443]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a3e0b-9eee-4a68-b501-b5d7b9f5479c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fbb6e4-1fc9-4949-8329-fe17a2c72ad1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a377b01-5680-4135-ac18-785c169bc27b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:03:41 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:03:41 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ecb2d4-1dd2-42e4-89b5-49a62acf5f3c]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG os_brick.utils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:03:41 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating existing volume attachment record: 2c9e9960-1a6b-4514-9e1f-4891d87361ed {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:03:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:55 user nova-compute[73007]: INFO nova.compute.manager [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Terminating instance
Aug 15 18:03:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcea8a6d-1282-436a-b183-16898d8e3f24 req-76eb2ef6-252f-414b-ac46-73083bde7865 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received event network-vif-unplugged-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcea8a6d-1282-436a-b183-16898d8e3f24 req-76eb2ef6-252f-414b-ac46-73083bde7865 service nova] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcea8a6d-1282-436a-b183-16898d8e3f24 req-76eb2ef6-252f-414b-ac46-73083bde7865 service nova] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fcea8a6d-1282-436a-b183-16898d8e3f24 req-76eb2ef6-252f-414b-ac46-73083bde7865 service nova] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcea8a6d-1282-436a-b183-16898d8e3f24 req-76eb2ef6-252f-414b-ac46-73083bde7865 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] No waiting events found dispatching network-vif-unplugged-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-fcea8a6d-1282-436a-b183-16898d8e3f24 req-76eb2ef6-252f-414b-ac46-73083bde7865 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received event network-vif-unplugged-0d174333-6d24-437d-9d7a-83276d86714d for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Instance destroyed successfully.
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lazy-loading 'resources' on Instance uuid 029c5519-9937-439c-9fc7-f1bad76d26f9 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-878804793',display_name='tempest-SnapshotDataIntegrityTests-server-878804793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-878804793',id=34,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbsKi/TUn80D7VNmUGtq5O2ZndwslJrZUfEc0yJRW3DewinuFvmrt+HIdIpmfAySN//REStdKePc2qzBZCYKbaJU31kNi3xzF41LyJcKGa5URqJ1cV4Dsb1uwYePQ1Dvg==',key_name='tempest-keypair-1584995018',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5401402cccbc447bae758f0ad20013ea',ramdisk_id='',reservation_id='r-m8cmkjpq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1339533230',owner_user_name='tempest-SnapshotDataIntegrityTests-1339533230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:56:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ea224a19a063435d98885a8831d4871f',uuid=029c5519-9937-439c-9fc7-f1bad76d26f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Converting VIF {"id": "0d174333-6d24-437d-9d7a-83276d86714d", "address": "fa:16:3e:6b:92:1b", "network": {"id": "d90fd017-909d-48f1-90db-ed5d3d2f8c04", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-30969035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5401402cccbc447bae758f0ad20013ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d174333-6d", "ovs_interfaceid": "0d174333-6d24-437d-9d7a-83276d86714d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:92:1b,bridge_name='br-int',has_traffic_filtering=True,id=0d174333-6d24-437d-9d7a-83276d86714d,network=Network(d90fd017-909d-48f1-90db-ed5d3d2f8c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d174333-6d') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG os_vif [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:92:1b,bridge_name='br-int',has_traffic_filtering=True,id=0d174333-6d24-437d-9d7a-83276d86714d,network=Network(d90fd017-909d-48f1-90db-ed5d3d2f8c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d174333-6d') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d174333-6d, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:03:56 user nova-compute[73007]: INFO os_vif [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:92:1b,bridge_name='br-int',has_traffic_filtering=True,id=0d174333-6d24-437d-9d7a-83276d86714d,network=Network(d90fd017-909d-48f1-90db-ed5d3d2f8c04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d174333-6d')
Aug 15 18:03:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Deleting instance files /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9_del
Aug 15 18:03:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Deletion of /opt/stack/data/nova/instances/029c5519-9937-439c-9fc7-f1bad76d26f9_del complete
Aug 15 18:03:56 user nova-compute[73007]: INFO nova.compute.manager [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 18:03:56 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:03:56 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:03:57 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:03:57 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Took 1.22 seconds to deallocate network for instance.
Aug 15 18:03:57 user nova-compute[73007]: DEBUG nova.compute.manager [req-51d62fa6-3d3d-42b7-bd35-24a6e39c02bc req-78b78580-068c-4a7e-877c-bb54462a8775 service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received event network-vif-deleted-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:57 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-7e7c531c-de4a-4554-bf57-17e72d5ca303 req-687f56fc-1457-44fe-a706-29edf8c7532d service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received event network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7e7c531c-de4a-4554-bf57-17e72d5ca303 req-687f56fc-1457-44fe-a706-29edf8c7532d service nova] Acquiring lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7e7c531c-de4a-4554-bf57-17e72d5ca303 req-687f56fc-1457-44fe-a706-29edf8c7532d service nova] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7e7c531c-de4a-4554-bf57-17e72d5ca303 req-687f56fc-1457-44fe-a706-29edf8c7532d service nova] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG nova.compute.manager [req-7e7c531c-de4a-4554-bf57-17e72d5ca303 req-687f56fc-1457-44fe-a706-29edf8c7532d service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] No waiting events found dispatching network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:58 user nova-compute[73007]: WARNING nova.compute.manager [req-7e7c531c-de4a-4554-bf57-17e72d5ca303 req-687f56fc-1457-44fe-a706-29edf8c7532d service nova] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Received unexpected event network-vif-plugged-0d174333-6d24-437d-9d7a-83276d86714d for instance with vm_state deleted and task_state None.
Aug 15 18:03:58 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:58 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Deleted allocations for instance 029c5519-9937-439c-9fc7-f1bad76d26f9
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3234a711-f1de-414a-a909-4c19fc062d1d tempest-SnapshotDataIntegrityTests-1339533230 tempest-SnapshotDataIntegrityTests-1339533230-project-member] Lock "029c5519-9937-439c-9fc7-f1bad76d26f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.815s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "0678e5e5-d3d8-43f0-937d-e367bd94329a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:58 user nova-compute[73007]: INFO nova.compute.manager [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Terminating instance
Aug 15 18:03:58 user nova-compute[73007]: DEBUG nova.compute.manager [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:59 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Instance destroyed successfully.
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.objects.instance [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lazy-loading 'resources' on Instance uuid 0678e5e5-d3d8-43f0-937d-e367bd94329a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2046663213',display_name='tempest-VolumesNegativeTest-instance-2046663213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2046663213',id=42,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:02:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89c9a3513ed8408e97ab7ac339faba47',ramdisk_id='',reservation_id='r-720ld023',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1496227351',owner_user_name='tempest-VolumesNegativeTest-1496227351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:02:16Z,user_data=None,user_id='5a5e100257194a25b2f284f6192a6217',uuid=0678e5e5-d3d8-43f0-937d-e367bd94329a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Converting VIF {"id": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "address": "fa:16:3e:7c:54:63", "network": {"id": "f1f71048-d03e-4c47-9c07-1c85c7939802", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d8b94772033b4529b2f86709fac0a483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc794b1f4-45", "ovs_interfaceid": "c794b1f4-4544-422b-92d8-a08ff0fbc22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:54:63,bridge_name='br-int',has_traffic_filtering=True,id=c794b1f4-4544-422b-92d8-a08ff0fbc22b,network=Network(f1f71048-d03e-4c47-9c07-1c85c7939802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc794b1f4-45') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG os_vif [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:54:63,bridge_name='br-int',has_traffic_filtering=True,id=c794b1f4-4544-422b-92d8-a08ff0fbc22b,network=Network(f1f71048-d03e-4c47-9c07-1c85c7939802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc794b1f4-45') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc794b1f4-45, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:03:59 user nova-compute[73007]: INFO os_vif [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:54:63,bridge_name='br-int',has_traffic_filtering=True,id=c794b1f4-4544-422b-92d8-a08ff0fbc22b,network=Network(f1f71048-d03e-4c47-9c07-1c85c7939802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc794b1f4-45')
Aug 15 18:03:59 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Deleting instance files /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a_del
Aug 15 18:03:59 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Deletion of /opt/stack/data/nova/instances/0678e5e5-d3d8-43f0-937d-e367bd94329a_del complete
Aug 15 18:03:59 user nova-compute[73007]: INFO nova.compute.manager [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 18:03:59 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received event network-vif-unplugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] Acquiring lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] No waiting events found dispatching network-vif-unplugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received event network-vif-unplugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received event network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] Acquiring lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:03:59 user nova-compute[73007]: DEBUG nova.compute.manager [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] No waiting events found dispatching network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:03:59 user nova-compute[73007]: WARNING nova.compute.manager [req-b75bf554-c194-4446-a5e3-aa54791b1617 req-8f80f6aa-dc8d-4ce2-a32d-7f9a9c0c457b service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received unexpected event network-vif-plugged-c794b1f4-4544-422b-92d8-a08ff0fbc22b for instance with vm_state active and task_state deleting.
Aug 15 18:04:00 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:00 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Took 0.58 seconds to deallocate network for instance.
Aug 15 18:04:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:00 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:04:00 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:04:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:00 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Deleted allocations for instance 0678e5e5-d3d8-43f0-937d-e367bd94329a
Aug 15 18:04:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-66fe3a53-f4f1-4290-a4df-b16a24261061 tempest-VolumesNegativeTest-1496227351 tempest-VolumesNegativeTest-1496227351-project-member] Lock "0678e5e5-d3d8-43f0-937d-e367bd94329a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUJqYkZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:04:01 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:04:01 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:04:01 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8189ec09-9b8d-44eb-b822-d966235d4077]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:04:01 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b921010-6eb2-402b-9b7f-65b8973072c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766] added
Aug 15 18:04:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1166bb-3dc7-4d87-9f34-7bd75f82b376]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9126b3-cd93-4e8b-8d64-a5bf6fc8932f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUJqYkZQ {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUJqYkZQ" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6709a758-bdfc-49bd-9168-3afe808fcd6b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUJqYkZQ'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[045d1735-5f31-4b07-a6fb-35ed3679b45a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[44844108-1463-429e-99c7-04f36063543c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba60c0f1-0d70-479f-a6df-ce7958181aaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260]
Aug 15 18:04:01 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260] successful.
Aug 15 18:04:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[85005d8f-c92c-481f-8734-c9ebfbdbe026]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b0861a-00fa-4027-ac6d-47858e1cea5a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:01 user nova-compute[73007]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] HCTL ('38', '-', '-', 0) found on session 52 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[836ade80-9e90-4da8-86b7-ed2feba5d167]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching for a device in session 52 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:04:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUJqYkZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:04:02 user nova-compute[73007]: DEBUG nova.compute.manager [req-a6b907bb-5e23-4fcc-8c7b-d9ca52c12e28 req-9ee541a8-c7ae-4581-a5e7-0e6715f743b0 service nova] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Received event network-vif-deleted-c794b1f4-4544-422b-92d8-a08ff0fbc22b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:04:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23165336235353466', 'path': '/dev/sdg'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:04:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165336235353466', 'path': '/dev/sdg'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:04:02 user nova-compute[73007]: DEBUG nova.objects.instance [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'flavor' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:04:02 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:04:02 user nova-compute[73007]:   <source dev="/dev/sdg"/>
Aug 15 18:04:02 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:04:02 user nova-compute[73007]:   <serial>19dffe87-082a-483f-96c0-a21015468766</serial>
Aug 15 18:04:02 user nova-compute[73007]: </disk>
Aug 15 18:04:02 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:04:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:04:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:04:03 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No VIF found with MAC fa:16:3e:f0:3a:c8, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:04:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27848175-2cbf-436f-9934-c7be7539ea00 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.804s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:10 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 18:04:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 18:04:11 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122636.5067513, 029c5519-9937-439c-9fc7-f1bad76d26f9 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:11 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] VM Stopped (Lifecycle Event)
Aug 15 18:04:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-77992318-253b-4c68-b943-647352049ce1 None None] [instance: 029c5519-9937-439c-9fc7-f1bad76d26f9] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-017f2700-a043-420e-af45-eb328f320f89 req-ee05dd36-a896-4958-a1cc-561c2d0a3a85 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-017f2700-a043-420e-af45-eb328f320f89 req-ee05dd36-a896-4958-a1cc-561c2d0a3a85 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing instance network info cache due to event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-017f2700-a043-420e-af45-eb328f320f89 req-ee05dd36-a896-4958-a1cc-561c2d0a3a85 service nova] Acquiring lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-017f2700-a043-420e-af45-eb328f320f89 req-ee05dd36-a896-4958-a1cc-561c2d0a3a85 service nova] Acquired lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-017f2700-a043-420e-af45-eb328f320f89 req-ee05dd36-a896-4958-a1cc-561c2d0a3a85 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122639.3472106, 0678e5e5-d3d8-43f0-937d-e367bd94329a => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:14 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] VM Stopped (Lifecycle Event)
Aug 15 18:04:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f423d45e-dd81-462d-b07b-acecbe25666e None None] [instance: 0678e5e5-d3d8-43f0-937d-e367bd94329a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.004s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-017f2700-a043-420e-af45-eb328f320f89 req-ee05dd36-a896-4958-a1cc-561c2d0a3a85 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updated VIF entry in instance network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-017f2700-a043-420e-af45-eb328f320f89 req-ee05dd36-a896-4958-a1cc-561c2d0a3a85 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating instance_info_cache with network_info: [{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-017f2700-a043-420e-af45-eb328f320f89 req-ee05dd36-a896-4958-a1cc-561c2d0a3a85 service nova] Releasing lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-96853bae-14f9-40fd-a971-8fb8de84344a req-a3b96ed6-b9b5-4c14-96cc-63ce148e4c0a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-96853bae-14f9-40fd-a971-8fb8de84344a req-a3b96ed6-b9b5-4c14-96cc-63ce148e4c0a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing instance network info cache due to event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-96853bae-14f9-40fd-a971-8fb8de84344a req-a3b96ed6-b9b5-4c14-96cc-63ce148e4c0a service nova] Acquiring lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-96853bae-14f9-40fd-a971-8fb8de84344a req-a3b96ed6-b9b5-4c14-96cc-63ce148e4c0a service nova] Acquired lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG nova.network.neutron [req-96853bae-14f9-40fd-a971-8fb8de84344a req-a3b96ed6-b9b5-4c14-96cc-63ce148e4c0a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG nova.network.neutron [req-96853bae-14f9-40fd-a971-8fb8de84344a req-a3b96ed6-b9b5-4c14-96cc-63ce148e4c0a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updated VIF entry in instance network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG nova.network.neutron [req-96853bae-14f9-40fd-a971-8fb8de84344a req-a3b96ed6-b9b5-4c14-96cc-63ce148e4c0a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating instance_info_cache with network_info: [{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-96853bae-14f9-40fd-a971-8fb8de84344a req-a3b96ed6-b9b5-4c14-96cc-63ce148e4c0a service nova] Releasing lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:04:20 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:04:20 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=6929MB free_disk=24.77184295654297GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance da287ce9-0600-43be-94aa-038eb1edaf07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5d29f229-4024-4a0e-b18a-b7a79de8c583 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6545b6a7-4c0e-4d97-8c98-7491292c566a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e80a756d-ec14-417e-8164-a1e9db7041d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 51963042-c0c7-4cda-8700-3de6115b9e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 18:04:20 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 18:04:21 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:04:21 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:04:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:04:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.888s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:22 user nova-compute[73007]: INFO nova.compute.manager [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Rebooting instance
Aug 15 18:04:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquired lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:22 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating instance_info_cache with network_info: [{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Releasing lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-e47e66fa-0e54-4c74-92fc-fb34b3a17373 req-b473f53f-23f8-4417-80a1-4fc769a311f5 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-unplugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e47e66fa-0e54-4c74-92fc-fb34b3a17373 req-b473f53f-23f8-4417-80a1-4fc769a311f5 service nova] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e47e66fa-0e54-4c74-92fc-fb34b3a17373 req-b473f53f-23f8-4417-80a1-4fc769a311f5 service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e47e66fa-0e54-4c74-92fc-fb34b3a17373 req-b473f53f-23f8-4417-80a1-4fc769a311f5 service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-e47e66fa-0e54-4c74-92fc-fb34b3a17373 req-b473f53f-23f8-4417-80a1-4fc769a311f5 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] No waiting events found dispatching network-vif-unplugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:23 user nova-compute[73007]: WARNING nova.compute.manager [req-e47e66fa-0e54-4c74-92fc-fb34b3a17373 req-b473f53f-23f8-4417-80a1-4fc769a311f5 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received unexpected event network-vif-unplugged-6120a809-279a-4cb4-b7d7-17da5e39273f for instance with vm_state active and task_state reboot_started_hard.
Aug 15 18:04:23 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Instance destroyed successfully.
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'resources' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1652858877',display_name='tempest-TestMinimumBasicScenario-server-1652858877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1652858877',id=41,image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgeUvRRpeWnwuUO8i59hmKKurHKDuyNddeJ5d2vXN4gN93Z9y7tetWok1QrY1pdDvYXaPQGwx9njGawQmiov6dk+UAW7t4DM9brzrIwaaT480dRSg3LiePVo60gQc/yNg==',key_name='tempest-TestMinimumBasicScenario-1607872540',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-tw49lt7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:04:23Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=6545b6a7-4c0e-4d97-8c98-7491292c566a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG os_vif [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6120a809-27, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:23 user nova-compute[73007]: INFO os_vif [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27')
Aug 15 18:04:23 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUJqYkZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:04:23 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:04:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:04:23 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[34313dd0-7c81-4b29-98c0-705c9d7299ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30c60b7-7408-49aa-b240-481de5ab1651]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7e16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766'): ({'sdg'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Removing single pathed devices sdg {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d83409e-4a15-4e7c-947b-01e786c04b39]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adeabf8-9ad8-4f38-8671-4a16036e6f94]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flushing IO for device /dev/sdg {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f8fbb0-4fc8-45ac-a11f-b72d3acafeaf]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95d0e15-9ca2-4d52-9a9d-98dd27a70c85]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] SCSI volumes sdg have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78c7ddf-5075-4c2d-8172-f51329edb37d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd23cfc5-b850-45a8-b879-636ab46e6eba]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260]
Aug 15 18:04:24 user nova-compute[73007]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260] successful.
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4961dcf1-5859-4c63-b501-115d1a2890fa]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] <== disconnect_volume: return (300ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Start _get_guest_xml network_info=[{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53b95b3d-55cc-4553-a1d3-d3cce54355b7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': '53b95b3d-55cc-4553-a1d3-d3cce54355b7'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUJqYkZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '6545b6a7-4c0e-4d97-8c98-7491292c566a', 'attached_at': '', 'detached_at': '', 'volume_id': '19dffe87-082a-483f-96c0-a21015468766', 'serial': '19dffe87-082a-483f-96c0-a21015468766'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '2c9e9960-1a6b-4514-9e1f-4891d87361ed', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:04:24 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:04:24 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=53b95b3d-55cc-4553-a1d3-d3cce54355b7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUJqYkZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:04:24 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:04:24 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:04:24 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66c070-31fe-427c-a7b1-e67a73e907b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:04:24 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[db26c811-784d-4bb9-9ef2-6d75ef28c940]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766] added
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf91185-1dcd-4b67-9748-609955f338a9]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faf9e9c-190b-4f88-b9f2-bfe77f03c16a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUJqYkZQ {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUJqYkZQ" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64d24a-af61-47bc-a38c-fbe51a869bf9]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUJqYkZQ'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63c2f6c-0842-41a5-bfc9-ed79d3e167c3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa099bcd-5a88-4993-99a0-a2ef92e34c82]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[68adc8b2-7b64-4872-85f2-a166046de2d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260]
Aug 15 18:04:24 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260] successful.
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f33fb44-ee99-43b9-932e-5f5cc568e99b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1309832f-c5c6-4ccd-b121-06fd19a4364d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:24 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] HCTL ('38', '-', '-', 0) found on session 53 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[313c87ad-c342-4d52-bb91-55b6583d03c2]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching for a device in session 53 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:04:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUJqYkZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-5806bd95-056e-43a1-bc43-849cc78f5a1d req-9a5c4f07-0efd-4c48-9186-ac17acf5bf4a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5806bd95-056e-43a1-bc43-849cc78f5a1d req-9a5c4f07-0efd-4c48-9186-ac17acf5bf4a service nova] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5806bd95-056e-43a1-bc43-849cc78f5a1d req-9a5c4f07-0efd-4c48-9186-ac17acf5bf4a service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5806bd95-056e-43a1-bc43-849cc78f5a1d req-9a5c4f07-0efd-4c48-9186-ac17acf5bf4a service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-5806bd95-056e-43a1-bc43-849cc78f5a1d req-9a5c4f07-0efd-4c48-9186-ac17acf5bf4a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] No waiting events found dispatching network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:25 user nova-compute[73007]: WARNING nova.compute.manager [req-5806bd95-056e-43a1-bc43-849cc78f5a1d req-9a5c4f07-0efd-4c48-9186-ac17acf5bf4a service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received unexpected event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f for instance with vm_state active and task_state reboot_started_hard.
Aug 15 18:04:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23165336235353466', 'path': '/dev/sdg'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165336235353466', 'path': '/dev/sdg'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1652858877',display_name='tempest-TestMinimumBasicScenario-server-1652858877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1652858877',id=41,image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgeUvRRpeWnwuUO8i59hmKKurHKDuyNddeJ5d2vXN4gN93Z9y7tetWok1QrY1pdDvYXaPQGwx9njGawQmiov6dk+UAW7t4DM9brzrIwaaT480dRSg3LiePVo60gQc/yNg==',key_name='tempest-TestMinimumBasicScenario-1607872540',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-tw49lt7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:04:23Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=6545b6a7-4c0e-4d97-8c98-7491292c566a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'pci_devices' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:04:25 user nova-compute[73007]:   <uuid>6545b6a7-4c0e-4d97-8c98-7491292c566a</uuid>
Aug 15 18:04:25 user nova-compute[73007]:   <name>instance-00000029</name>
Aug 15 18:04:25 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:04:25 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:04:25 user nova-compute[73007]:   <metadata>
Aug 15 18:04:25 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:04:25 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:04:25 user nova-compute[73007]:       <nova:name>tempest-TestMinimumBasicScenario-server-1652858877</nova:name>
Aug 15 18:04:25 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:04:24</nova:creationTime>
Aug 15 18:04:25 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:04:25 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:04:25 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:04:25 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:04:25 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:04:25 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:04:25 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:04:25 user nova-compute[73007]:       <nova:owner>
Aug 15 18:04:25 user nova-compute[73007]:         <nova:user uuid="60ec8200260d42b7bdb788b3f745eb84">tempest-TestMinimumBasicScenario-1021033428-project-member</nova:user>
Aug 15 18:04:25 user nova-compute[73007]:         <nova:project uuid="06843dd305d24f79b1aa4f4772322248">tempest-TestMinimumBasicScenario-1021033428</nova:project>
Aug 15 18:04:25 user nova-compute[73007]:       </nova:owner>
Aug 15 18:04:25 user nova-compute[73007]:       <nova:root type="image" uuid="53b95b3d-55cc-4553-a1d3-d3cce54355b7"/>
Aug 15 18:04:25 user nova-compute[73007]:       <nova:ports>
Aug 15 18:04:25 user nova-compute[73007]:         <nova:port uuid="6120a809-279a-4cb4-b7d7-17da5e39273f">
Aug 15 18:04:25 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 18:04:25 user nova-compute[73007]:         </nova:port>
Aug 15 18:04:25 user nova-compute[73007]:       </nova:ports>
Aug 15 18:04:25 user nova-compute[73007]:     </nova:instance>
Aug 15 18:04:25 user nova-compute[73007]:   </metadata>
Aug 15 18:04:25 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:04:25 user nova-compute[73007]:     <system>
Aug 15 18:04:25 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:04:25 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:04:25 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:04:25 user nova-compute[73007]:       <entry name="serial">6545b6a7-4c0e-4d97-8c98-7491292c566a</entry>
Aug 15 18:04:25 user nova-compute[73007]:       <entry name="uuid">6545b6a7-4c0e-4d97-8c98-7491292c566a</entry>
Aug 15 18:04:25 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:04:25 user nova-compute[73007]:     </system>
Aug 15 18:04:25 user nova-compute[73007]:   </sysinfo>
Aug 15 18:04:25 user nova-compute[73007]:   <os>
Aug 15 18:04:25 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:04:25 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:04:25 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:04:25 user nova-compute[73007]:   </os>
Aug 15 18:04:25 user nova-compute[73007]:   <features>
Aug 15 18:04:25 user nova-compute[73007]:     <acpi/>
Aug 15 18:04:25 user nova-compute[73007]:     <apic/>
Aug 15 18:04:25 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:04:25 user nova-compute[73007]:   </features>
Aug 15 18:04:25 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:04:25 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:04:25 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:04:25 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:04:25 user nova-compute[73007]:   </clock>
Aug 15 18:04:25 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:04:25 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:04:25 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:04:25 user nova-compute[73007]:   </cpu>
Aug 15 18:04:25 user nova-compute[73007]:   <devices>
Aug 15 18:04:25 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:04:25 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:04:25 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk"/>
Aug 15 18:04:25 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:04:25 user nova-compute[73007]:     </disk>
Aug 15 18:04:25 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:04:25 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:04:25 user nova-compute[73007]:       <source dev="/dev/sdg"/>
Aug 15 18:04:25 user nova-compute[73007]:       <target dev="vdb" bus="virtio"/>
Aug 15 18:04:25 user nova-compute[73007]:       <serial>19dffe87-082a-483f-96c0-a21015468766</serial>
Aug 15 18:04:25 user nova-compute[73007]:     </disk>
Aug 15 18:04:25 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:04:25 user nova-compute[73007]:       <mac address="fa:16:3e:f0:3a:c8"/>
Aug 15 18:04:25 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:04:25 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:04:25 user nova-compute[73007]:       <target dev="tap6120a809-27"/>
Aug 15 18:04:25 user nova-compute[73007]:     </interface>
Aug 15 18:04:25 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:04:25 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/console.log" append="off"/>
Aug 15 18:04:25 user nova-compute[73007]:     </serial>
Aug 15 18:04:25 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:04:25 user nova-compute[73007]:     <video>
Aug 15 18:04:25 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:04:25 user nova-compute[73007]:     </video>
Aug 15 18:04:25 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:04:25 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:04:25 user nova-compute[73007]:     </rng>
Aug 15 18:04:25 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:04:25 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:04:25 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:04:25 user nova-compute[73007]:     </memballoon>
Aug 15 18:04:25 user nova-compute[73007]:   </devices>
Aug 15 18:04:25 user nova-compute[73007]: </domain>
Aug 15 18:04:25 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:26 user nova-compute[73007]: INFO nova.compute.manager [None req-2731f793-4695-41ff-900f-579c3eb62789 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Unrescuing
Aug 15 18:04:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2731f793-4695-41ff-900f-579c3eb62789 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2731f793-4695-41ff-900f-579c3eb62789 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquired lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2731f793-4695-41ff-900f-579c3eb62789 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Cannot resize image /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'migration_context' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1652858877',display_name='tempest-TestMinimumBasicScenario-server-1652858877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1652858877',id=41,image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgeUvRRpeWnwuUO8i59hmKKurHKDuyNddeJ5d2vXN4gN93Z9y7tetWok1QrY1pdDvYXaPQGwx9njGawQmiov6dk+UAW7t4DM9brzrIwaaT480dRSg3LiePVo60gQc/yNg==',key_name='tempest-TestMinimumBasicScenario-1607872540',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-tw49lt7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:04:23Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=6545b6a7-4c0e-4d97-8c98-7491292c566a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG os_vif [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6120a809-27, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6120a809-27, col_values=(('external_ids', {'iface-id': '6120a809-279a-4cb4-b7d7-17da5e39273f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:3a:c8', 'vm-uuid': '6545b6a7-4c0e-4d97-8c98-7491292c566a'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:26 user nova-compute[73007]: INFO os_vif [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27')
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-2731f793-4695-41ff-900f-579c3eb62789 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2731f793-4695-41ff-900f-579c3eb62789 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Releasing lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2731f793-4695-41ff-900f-579c3eb62789 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'flavor' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-21741e0f-e858-49fc-a8d5-7ea6dc390927 req-d859ad36-5f31-4f7b-a6ed-d79a2c47fbaf service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-21741e0f-e858-49fc-a8d5-7ea6dc390927 req-d859ad36-5f31-4f7b-a6ed-d79a2c47fbaf service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-21741e0f-e858-49fc-a8d5-7ea6dc390927 req-d859ad36-5f31-4f7b-a6ed-d79a2c47fbaf service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-21741e0f-e858-49fc-a8d5-7ea6dc390927 req-d859ad36-5f31-4f7b-a6ed-d79a2c47fbaf service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-21741e0f-e858-49fc-a8d5-7ea6dc390927 req-d859ad36-5f31-4f7b-a6ed-d79a2c47fbaf service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:27 user nova-compute[73007]: WARNING nova.compute.manager [req-21741e0f-e858-49fc-a8d5-7ea6dc390927 req-d859ad36-5f31-4f7b-a6ed-d79a2c47fbaf service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 18:04:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Stashing vm_state: active {{(pid=73007) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-changed-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Refreshing instance network info cache due to event network-changed-06d8a570-8b59-44eb-874e-55022131b039. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] Acquiring lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] Acquired lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.network.neutron [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Refreshing network info cache for port 06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'pci_requests' on Instance uuid 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:04:27 user nova-compute[73007]: INFO nova.compute.claims [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Claim successful on node user
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'resources' on Instance uuid 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'pci_devices' on Instance uuid 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:27 user nova-compute[73007]: INFO nova.compute.resource_tracker [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating resource usage from migration 889ffed9-7244-4055-baa4-000154bb6933
Aug 15 18:04:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updated VIF entry in instance network info cache for port 06d8a570-8b59-44eb-874e-55022131b039. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] Releasing lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-changed-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Refreshing instance network info cache due to event network-changed-96ecbd22-c121-40ce-8f58-9c14788d09fb. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] Acquiring lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] Acquired lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Refreshing network info cache for port 96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.550s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:28 user nova-compute[73007]: INFO nova.compute.manager [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Migrating
Aug 15 18:04:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:28 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance destroyed successfully.
Aug 15 18:04:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updated VIF entry in instance network info cache for port 96ecbd22-c121-40ce-8f58-9c14788d09fb. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating instance_info_cache with network_info: [{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-783400db-350e-4e31-86fb-adaf30128f9f req-b77c07bf-7d53-456b-9df5-0fcf4834cb67 service nova] Releasing lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquired lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.network.neutron [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-426dafbf-a0d9-495a-adab-9719a356daf8 req-9ecba4f7-dfcb-4d38-928c-de1533c7c88b service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-426dafbf-a0d9-495a-adab-9719a356daf8 req-9ecba4f7-dfcb-4d38-928c-de1533c7c88b service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-426dafbf-a0d9-495a-adab-9719a356daf8 req-9ecba4f7-dfcb-4d38-928c-de1533c7c88b service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-426dafbf-a0d9-495a-adab-9719a356daf8 req-9ecba4f7-dfcb-4d38-928c-de1533c7c88b service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-426dafbf-a0d9-495a-adab-9719a356daf8 req-9ecba4f7-dfcb-4d38-928c-de1533c7c88b service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:29 user nova-compute[73007]: WARNING nova.compute.manager [req-426dafbf-a0d9-495a-adab-9719a356daf8 req-9ecba4f7-dfcb-4d38-928c-de1533c7c88b service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] No waiting events found dispatching network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:29 user nova-compute[73007]: WARNING nova.compute.manager [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received unexpected event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f for instance with vm_state active and task_state reboot_started_hard.
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] No waiting events found dispatching network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:29 user nova-compute[73007]: WARNING nova.compute.manager [req-1aeceb2b-989e-4347-b0c7-455bec847868 req-f6224e8a-3b06-4943-8f83-628ea3a38538 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received unexpected event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f for instance with vm_state active and task_state reboot_started_hard.
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.network.neutron [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating instance_info_cache with network_info: [{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Releasing lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Starting migrate_disk_and_power_off {{(pid=73007) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-6a169a57-3059-41fd-9e4c-92ecb5099e4f req-0b053610-98e8-4248-bc67-db95ae50487b service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-unplugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6a169a57-3059-41fd-9e4c-92ecb5099e4f req-0b053610-98e8-4248-bc67-db95ae50487b service nova] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6a169a57-3059-41fd-9e4c-92ecb5099e4f req-0b053610-98e8-4248-bc67-db95ae50487b service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6a169a57-3059-41fd-9e4c-92ecb5099e4f req-0b053610-98e8-4248-bc67-db95ae50487b service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-6a169a57-3059-41fd-9e4c-92ecb5099e4f req-0b053610-98e8-4248-bc67-db95ae50487b service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] No waiting events found dispatching network-vif-unplugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:30 user nova-compute[73007]: WARNING nova.compute.manager [req-6a169a57-3059-41fd-9e4c-92ecb5099e4f req-0b053610-98e8-4248-bc67-db95ae50487b service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received unexpected event network-vif-unplugged-96ecbd22-c121-40ce-8f58-9c14788d09fb for instance with vm_state active and task_state resize_migrating.
Aug 15 18:04:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:30 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance destroyed successfully.
Aug 15 18:04:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1151877584',display_name='tempest-ServerActionsTestOtherA-server-1151877584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1151877584',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-18dn6xtt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:04:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=693cc4d3-51fc-4d13-b5aa-832d22b1ebdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1175629755-network", "vif_mac": "fa:16:3e:29:55:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1175629755-network", "vif_mac": "fa:16:3e:29:55:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_vif [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96ecbd22-c1, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:04:30 user nova-compute[73007]: INFO os_vif [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1')
Aug 15 18:04:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBNEeqIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:04:30 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dbaafd-6e07-4340-8788-388eebd136bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0a2a87-7908-471d-858f-16a7f86cacb2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:30 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c606440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[414e5b64-2191-4495-8227-031020b9a39a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c896a89-a12e-49ae-998f-addebe45b2b0]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60f040d-3027-423e-af0d-6346785f1a3c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b775dd8-b0cb-4f9a-be35-b9dbbb36e95c]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca5c6a3-a42f-4a4c-a280-e6db3e0404a8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684af0b-87f9-4e20-a847-449d214c75aa]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260]
Aug 15 18:04:30 user nova-compute[73007]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260] successful.
Aug 15 18:04:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[27476146-89f4-4fde-ad63-cb324c40639e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== disconnect_volume: return (302ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:31 user nova-compute[73007]: WARNING nova.compute.manager [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:31 user nova-compute[73007]: WARNING nova.compute.manager [req-6dc72e39-0251-4b93-bd12-a7fb859453c8 req-d67e3960-843c-4e14-953d-0756831cf8db service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state rescued and task_state unrescuing.
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for 6545b6a7-4c0e-4d97-8c98-7491292c566a due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122671.6008573, 6545b6a7-4c0e-4d97-8c98-7491292c566a => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:31 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] VM Resumed (Lifecycle Event)
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:04:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Instance rebooted successfully.
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:04:31 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122671.601589, 6545b6a7-4c0e-4d97-8c98-7491292c566a => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:31 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] VM Started (Lifecycle Event)
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:04:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2b76065f-6053-4d3c-8fa1-b5c7027f4a3c tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.155s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Port 96ecbd22-c121-40ce-8f58-9c14788d09fb binding to destination host user is already ACTIVE {{(pid=73007) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-7354990b-615a-4eaf-8cf0-debb137845f9 req-dedd4f79-ccdd-4c37-b62c-4adeeba0c4b2 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7354990b-615a-4eaf-8cf0-debb137845f9 req-dedd4f79-ccdd-4c37-b62c-4adeeba0c4b2 service nova] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7354990b-615a-4eaf-8cf0-debb137845f9 req-dedd4f79-ccdd-4c37-b62c-4adeeba0c4b2 service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7354990b-615a-4eaf-8cf0-debb137845f9 req-dedd4f79-ccdd-4c37-b62c-4adeeba0c4b2 service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-7354990b-615a-4eaf-8cf0-debb137845f9 req-dedd4f79-ccdd-4c37-b62c-4adeeba0c4b2 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] No waiting events found dispatching network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:32 user nova-compute[73007]: WARNING nova.compute.manager [req-7354990b-615a-4eaf-8cf0-debb137845f9 req-dedd4f79-ccdd-4c37-b62c-4adeeba0c4b2 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received unexpected event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb for instance with vm_state active and task_state resize_migrated.
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquired lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for da287ce9-0600-43be-94aa-038eb1edaf07 due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122672.5131288, da287ce9-0600-43be-94aa-038eb1edaf07 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] VM Resumed (Lifecycle Event)
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2731f793-4695-41ff-900f-579c3eb62789 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:04:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122672.514929, da287ce9-0600-43be-94aa-038eb1edaf07 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] VM Started (Lifecycle Event)
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating instance_info_cache with network_info: [{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Releasing lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG os_brick.utils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda68c36-1f73-4a4f-af4e-23202cf21b94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3688438f-1323-40a3-b2a2-f41a29be8acd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:32 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[522cd20a-20aa-4919-be48-4071df8a50e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cad25d-d093-4db9-a1f5-d37c0d298f02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:04:33 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:04:33 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2340d273-5cd0-4afa-962a-361bec28b33a]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG os_brick.utils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:04:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Starting finish_migration {{(pid=73007) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance directory exists: not creating {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 18:04:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Creating image(s)
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Ensure instance console log exists: /opt/stack/data/nova/instances/693cc4d3-51fc-4d13-b5aa-832d22b1ebdd/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Start _get_guest_xml network_info=[{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1175629755-network", "vif_mac": "fa:16:3e:29:55:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBNEeqIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '693cc4d3-51fc-4d13-b5aa-832d22b1ebdd', 'attached_at': '2023-08-15T18:04:43.000000', 'detached_at': '', 'volume_id': '66b06d0a-bef1-4068-bf1c-dfcb78d979ef', 'serial': '66b06d0a-bef1-4068-bf1c-dfcb78d979ef'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'b311e186-65eb-48a0-9a0b-99858edc8a26', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:04:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:04:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.objects.instance [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'vcpu_model' on Instance uuid 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBNEeqIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:04:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:04:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:04:42 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7037095-481d-47b0-aef5-e8200b67d571]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:04:42 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2cf4fc-7ce9-481f-9cea-edbbfeedb830]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef] added
Aug 15 18:04:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0339303d-74f7-47a6-943f-9a59d0e7602a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa64fc8-a8c1-45db-ac0e-fcc10de9767b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBNEeqIO {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBNEeqIO" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca019cdf-2f92-46c8-a77a-605ed6db1115]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uBNEeqIO'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5fd801-76b2-4cee-b0ae-5ace535ade20]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[af80be6e-8dbb-436c-ae48-ae3c2249b80a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b972af6-4c53-4ef8-a85f-f8aed5236bb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260]
Aug 15 18:04:43 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260] successful.
Aug 15 18:04:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5569a6-2896-4762-b39f-78472ba6a6a3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba783e9d-dd5c-4dc6-b72e-132bb1822cda]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:04:43 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:04:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dcb48b-061b-4498-9789-d2a96466604a]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:04:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBNEeqIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26632386632366165', 'path': '/dev/sde'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632386632366165', 'path': '/dev/sde'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1151877584',display_name='tempest-ServerActionsTestOtherA-server-1151877584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1151877584',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-18dn6xtt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=693cc4d3-51fc-4d13-b5aa-832d22b1ebdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1175629755-network", "vif_mac": "fa:16:3e:29:55:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1175629755-network", "vif_mac": "fa:16:3e:29:55:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:04:44 user nova-compute[73007]:   <uuid>693cc4d3-51fc-4d13-b5aa-832d22b1ebdd</uuid>
Aug 15 18:04:44 user nova-compute[73007]:   <name>instance-0000002b</name>
Aug 15 18:04:44 user nova-compute[73007]:   <memory>2097152</memory>
Aug 15 18:04:44 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:04:44 user nova-compute[73007]:   <metadata>
Aug 15 18:04:44 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:04:44 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:04:44 user nova-compute[73007]:       <nova:name>tempest-ServerActionsTestOtherA-server-1151877584</nova:name>
Aug 15 18:04:44 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:04:42</nova:creationTime>
Aug 15 18:04:44 user nova-compute[73007]:       <nova:flavor name="m1.small">
Aug 15 18:04:44 user nova-compute[73007]:         <nova:memory>2048</nova:memory>
Aug 15 18:04:44 user nova-compute[73007]:         <nova:disk>20</nova:disk>
Aug 15 18:04:44 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:04:44 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:04:44 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:04:44 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:04:44 user nova-compute[73007]:       <nova:owner>
Aug 15 18:04:44 user nova-compute[73007]:         <nova:user uuid="d52391420381427297cc8c55600112b0">tempest-ServerActionsTestOtherA-226008880-project-member</nova:user>
Aug 15 18:04:44 user nova-compute[73007]:         <nova:project uuid="09ba0a5fb91043d9a46323b202cd924c">tempest-ServerActionsTestOtherA-226008880</nova:project>
Aug 15 18:04:44 user nova-compute[73007]:       </nova:owner>
Aug 15 18:04:44 user nova-compute[73007]:       <nova:ports>
Aug 15 18:04:44 user nova-compute[73007]:         <nova:port uuid="96ecbd22-c121-40ce-8f58-9c14788d09fb">
Aug 15 18:04:44 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 18:04:44 user nova-compute[73007]:         </nova:port>
Aug 15 18:04:44 user nova-compute[73007]:       </nova:ports>
Aug 15 18:04:44 user nova-compute[73007]:     </nova:instance>
Aug 15 18:04:44 user nova-compute[73007]:   </metadata>
Aug 15 18:04:44 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:04:44 user nova-compute[73007]:     <system>
Aug 15 18:04:44 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:04:44 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:04:44 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:04:44 user nova-compute[73007]:       <entry name="serial">693cc4d3-51fc-4d13-b5aa-832d22b1ebdd</entry>
Aug 15 18:04:44 user nova-compute[73007]:       <entry name="uuid">693cc4d3-51fc-4d13-b5aa-832d22b1ebdd</entry>
Aug 15 18:04:44 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:04:44 user nova-compute[73007]:     </system>
Aug 15 18:04:44 user nova-compute[73007]:   </sysinfo>
Aug 15 18:04:44 user nova-compute[73007]:   <os>
Aug 15 18:04:44 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:04:44 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:04:44 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:04:44 user nova-compute[73007]:   </os>
Aug 15 18:04:44 user nova-compute[73007]:   <features>
Aug 15 18:04:44 user nova-compute[73007]:     <acpi/>
Aug 15 18:04:44 user nova-compute[73007]:     <apic/>
Aug 15 18:04:44 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:04:44 user nova-compute[73007]:   </features>
Aug 15 18:04:44 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:04:44 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:04:44 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:04:44 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:04:44 user nova-compute[73007]:   </clock>
Aug 15 18:04:44 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:04:44 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:04:44 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:04:44 user nova-compute[73007]:   </cpu>
Aug 15 18:04:44 user nova-compute[73007]:   <devices>
Aug 15 18:04:44 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:04:44 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:04:44 user nova-compute[73007]:       <source dev="/dev/sde"/>
Aug 15 18:04:44 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:04:44 user nova-compute[73007]:       <serial>66b06d0a-bef1-4068-bf1c-dfcb78d979ef</serial>
Aug 15 18:04:44 user nova-compute[73007]:     </disk>
Aug 15 18:04:44 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:04:44 user nova-compute[73007]:       <mac address="fa:16:3e:29:55:3d"/>
Aug 15 18:04:44 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:04:44 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:04:44 user nova-compute[73007]:       <target dev="tap96ecbd22-c1"/>
Aug 15 18:04:44 user nova-compute[73007]:     </interface>
Aug 15 18:04:44 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:04:44 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/693cc4d3-51fc-4d13-b5aa-832d22b1ebdd/console.log" append="off"/>
Aug 15 18:04:44 user nova-compute[73007]:     </serial>
Aug 15 18:04:44 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:04:44 user nova-compute[73007]:     <video>
Aug 15 18:04:44 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:04:44 user nova-compute[73007]:     </video>
Aug 15 18:04:44 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:04:44 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:04:44 user nova-compute[73007]:     </rng>
Aug 15 18:04:44 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:04:44 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:04:44 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:04:44 user nova-compute[73007]:     </memballoon>
Aug 15 18:04:44 user nova-compute[73007]:   </devices>
Aug 15 18:04:44 user nova-compute[73007]: </domain>
Aug 15 18:04:44 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1151877584',display_name='tempest-ServerActionsTestOtherA-server-1151877584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1151877584',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-18dn6xtt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=693cc4d3-51fc-4d13-b5aa-832d22b1ebdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1175629755-network", "vif_mac": "fa:16:3e:29:55:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1175629755-network", "vif_mac": "fa:16:3e:29:55:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG os_vif [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96ecbd22-c1, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96ecbd22-c1, col_values=(('external_ids', {'iface-id': '96ecbd22-c121-40ce-8f58-9c14788d09fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:55:3d', 'vm-uuid': '693cc4d3-51fc-4d13-b5aa-832d22b1ebdd'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:04:44 user nova-compute[73007]: INFO os_vif [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1')
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:04:44 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] No VIF found with MAC fa:16:3e:29:55:3d, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122670.6512725, 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:45 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] VM Stopped (Lifecycle Event)
Aug 15 18:04:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-cc007c97-165a-451b-8933-5820d8b34e70 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-8ea2498f-c65a-424a-a496-e60807c67096 req-c7fc69a3-3630-4b8f-b662-e193455cedb0 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ea2498f-c65a-424a-a496-e60807c67096 req-c7fc69a3-3630-4b8f-b662-e193455cedb0 service nova] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ea2498f-c65a-424a-a496-e60807c67096 req-c7fc69a3-3630-4b8f-b662-e193455cedb0 service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8ea2498f-c65a-424a-a496-e60807c67096 req-c7fc69a3-3630-4b8f-b662-e193455cedb0 service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-8ea2498f-c65a-424a-a496-e60807c67096 req-c7fc69a3-3630-4b8f-b662-e193455cedb0 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] No waiting events found dispatching network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:45 user nova-compute[73007]: WARNING nova.compute.manager [req-8ea2498f-c65a-424a-a496-e60807c67096 req-c7fc69a3-3630-4b8f-b662-e193455cedb0 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received unexpected event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb for instance with vm_state active and task_state resize_finish.
Aug 15 18:04:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122687.8017435, 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:47 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] VM Resumed (Lifecycle Event)
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:04:47 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance running successfully.
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Failed to set time: agent not configured {{(pid=73007) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-472f6ac1-760c-4fa0-9702-16f668bac322 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] finish_migration finished successfully. {{(pid=73007) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:04:47 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122687.8028455, 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:47 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] VM Started (Lifecycle Event)
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:04:47 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-72a5a023-0de2-47ab-bd06-bb37151cc353 req-8ba2d335-1d92-4a7d-b175-c1883dbe361e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-72a5a023-0de2-47ab-bd06-bb37151cc353 req-8ba2d335-1d92-4a7d-b175-c1883dbe361e service nova] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-72a5a023-0de2-47ab-bd06-bb37151cc353 req-8ba2d335-1d92-4a7d-b175-c1883dbe361e service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-72a5a023-0de2-47ab-bd06-bb37151cc353 req-8ba2d335-1d92-4a7d-b175-c1883dbe361e service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-72a5a023-0de2-47ab-bd06-bb37151cc353 req-8ba2d335-1d92-4a7d-b175-c1883dbe361e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] No waiting events found dispatching network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:47 user nova-compute[73007]: WARNING nova.compute.manager [req-72a5a023-0de2-47ab-bd06-bb37151cc353 req-8ba2d335-1d92-4a7d-b175-c1883dbe361e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received unexpected event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb for instance with vm_state active and task_state resize_finish.
Aug 15 18:04:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:50 user nova-compute[73007]: INFO nova.compute.manager [None req-ed952af5-ea7e-4f1a-81e0-e726b3dc5ed6 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Unrescuing
Aug 15 18:04:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed952af5-ea7e-4f1a-81e0-e726b3dc5ed6 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:04:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed952af5-ea7e-4f1a-81e0-e726b3dc5ed6 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquired lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:04:50 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ed952af5-ea7e-4f1a-81e0-e726b3dc5ed6 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:04:50 user nova-compute[73007]: DEBUG nova.network.neutron [None req-ed952af5-ea7e-4f1a-81e0-e726b3dc5ed6 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Updating instance_info_cache with network_info: [{"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:04:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ed952af5-ea7e-4f1a-81e0-e726b3dc5ed6 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Releasing lock "refresh_cache-5d29f229-4024-4a0e-b18a-b7a79de8c583" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:04:50 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ed952af5-ea7e-4f1a-81e0-e726b3dc5ed6 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'flavor' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:04:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-1595cd23-3baf-4cd4-afc2-cb93c3c9d353 req-54e5778a-628d-4414-ae9a-d1ac4904cb9a service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1595cd23-3baf-4cd4-afc2-cb93c3c9d353 req-54e5778a-628d-4414-ae9a-d1ac4904cb9a service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1595cd23-3baf-4cd4-afc2-cb93c3c9d353 req-54e5778a-628d-4414-ae9a-d1ac4904cb9a service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1595cd23-3baf-4cd4-afc2-cb93c3c9d353 req-54e5778a-628d-4414-ae9a-d1ac4904cb9a service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:51 user nova-compute[73007]: DEBUG nova.compute.manager [req-1595cd23-3baf-4cd4-afc2-cb93c3c9d353 req-54e5778a-628d-4414-ae9a-d1ac4904cb9a service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:51 user nova-compute[73007]: WARNING nova.compute.manager [req-1595cd23-3baf-4cd4-afc2-cb93c3c9d353 req-54e5778a-628d-4414-ae9a-d1ac4904cb9a service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state rescued and task_state unrescuing.
Aug 15 18:04:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance destroyed successfully.
Aug 15 18:04:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-b238035b-ff4c-4e73-95eb-428157df8ac8 req-50b48905-56f5-4f16-a85e-6f4d8c665c22 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b238035b-ff4c-4e73-95eb-428157df8ac8 req-50b48905-56f5-4f16-a85e-6f4d8c665c22 service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b238035b-ff4c-4e73-95eb-428157df8ac8 req-50b48905-56f5-4f16-a85e-6f4d8c665c22 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b238035b-ff4c-4e73-95eb-428157df8ac8 req-50b48905-56f5-4f16-a85e-6f4d8c665c22 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:53 user nova-compute[73007]: DEBUG nova.compute.manager [req-b238035b-ff4c-4e73-95eb-428157df8ac8 req-50b48905-56f5-4f16-a85e-6f4d8c665c22 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:53 user nova-compute[73007]: WARNING nova.compute.manager [req-b238035b-ff4c-4e73-95eb-428157df8ac8 req-50b48905-56f5-4f16-a85e-6f4d8c665c22 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state rescued and task_state unrescuing.
Aug 15 18:04:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:55 user nova-compute[73007]: WARNING nova.compute.manager [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state rescued and task_state unrescuing.
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:04:55 user nova-compute[73007]: WARNING nova.compute.manager [req-86649acd-277f-41e3-a201-fc461312c932 req-836fa245-c55c-4561-8372-9f9e2c9cbd74 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state rescued and task_state unrescuing.
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for 5d29f229-4024-4a0e-b18a-b7a79de8c583 due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122695.6588986, 5d29f229-4024-4a0e-b18a-b7a79de8c583 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:55 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] VM Resumed (Lifecycle Event)
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ed952af5-ea7e-4f1a-81e0-e726b3dc5ed6 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:04:55 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122695.6601603, 5d29f229-4024-4a0e-b18a-b7a79de8c583 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:04:55 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] VM Started (Lifecycle Event)
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:04:55 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:04:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:04:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ab63df06-e3d9-4c8a-823d-19e7a87f2e08 req-fdd9bedd-5095-445c-a59a-d3f5572b085c service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-changed-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:05:00 user nova-compute[73007]: DEBUG nova.compute.manager [req-ab63df06-e3d9-4c8a-823d-19e7a87f2e08 req-fdd9bedd-5095-445c-a59a-d3f5572b085c service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Refreshing instance network info cache due to event network-changed-3e388fd1-eeef-4853-b992-91c420a3c694. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:05:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ab63df06-e3d9-4c8a-823d-19e7a87f2e08 req-fdd9bedd-5095-445c-a59a-d3f5572b085c service nova] Acquiring lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:05:00 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ab63df06-e3d9-4c8a-823d-19e7a87f2e08 req-fdd9bedd-5095-445c-a59a-d3f5572b085c service nova] Acquired lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:05:00 user nova-compute[73007]: DEBUG nova.network.neutron [req-ab63df06-e3d9-4c8a-823d-19e7a87f2e08 req-fdd9bedd-5095-445c-a59a-d3f5572b085c service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Refreshing network info cache for port 3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:05:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-ab63df06-e3d9-4c8a-823d-19e7a87f2e08 req-fdd9bedd-5095-445c-a59a-d3f5572b085c service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updated VIF entry in instance network info cache for port 3e388fd1-eeef-4853-b992-91c420a3c694. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:05:01 user nova-compute[73007]: DEBUG nova.network.neutron [req-ab63df06-e3d9-4c8a-823d-19e7a87f2e08 req-fdd9bedd-5095-445c-a59a-d3f5572b085c service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updating instance_info_cache with network_info: [{"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:05:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ab63df06-e3d9-4c8a-823d-19e7a87f2e08 req-fdd9bedd-5095-445c-a59a-d3f5572b085c service nova] Releasing lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:05:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:13 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "ce363491-dc11-4d56-ad55-c675bfdae1b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid 582f3e3e-a05e-48dd-803d-b87a6eeda045 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:05:15 user nova-compute[73007]: INFO nova.compute.claims [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Claim successful on node user
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:05:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:05:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:05:16 user nova-compute[73007]: INFO nova.virt.block_device [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Booting with volume 4bd3bfbd-3a85-4b3c-815a-74040b1143fc at /dev/vda
Aug 15 18:05:16 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updating instance_info_cache with network_info: [{"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-582f3e3e-a05e-48dd-803d-b87a6eeda045" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG nova.policy [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cd910b3e8bf406f8512b3470f6eaca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6eebca3ef0a45788b0dfbc03b01fe8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG os_brick.utils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4101836-3794-4c77-91cd-2d7098235907]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[136fe6ba-2582-4ecd-a215-6f9235683d06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b982c9-01d7-48a1-b056-9abf9e9bd04b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f7b809-893d-4af9-b127-154e8f6c9303]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:05:16 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce72c0-1263-4abc-80f6-5a2aec3c2ccd]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG os_brick.utils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updating existing volume attachment record: ce3a47cc-d35e-4403-8b43-39b862022a64 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Successfully created port: 09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Successfully updated port: 09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquired lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-772cd581-79fa-4757-b5ea-8275f34f4c09 req-54624131-4762-453f-95fc-7085d63d4641 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-changed-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-772cd581-79fa-4757-b5ea-8275f34f4c09 req-54624131-4762-453f-95fc-7085d63d4641 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Refreshing instance network info cache due to event network-changed-09b2d2bf-f241-4f89-ad13-1df13d27f1fc. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-772cd581-79fa-4757-b5ea-8275f34f4c09 req-54624131-4762-453f-95fc-7085d63d4641 service nova] Acquiring lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updating instance_info_cache with network_info: [{"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Releasing lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Instance network_info: |[{"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-772cd581-79fa-4757-b5ea-8275f34f4c09 req-54624131-4762-453f-95fc-7085d63d4641 service nova] Acquired lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-772cd581-79fa-4757-b5ea-8275f34f4c09 req-54624131-4762-453f-95fc-7085d63d4641 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Refreshing network info cache for port 09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-05ea2717-2848-42b1-9bfa-ab01dd94970a req-f36fd00c-9664-44a6-b8b2-5001b2480a45 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received event network-changed-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-05ea2717-2848-42b1-9bfa-ab01dd94970a req-f36fd00c-9664-44a6-b8b2-5001b2480a45 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Refreshing instance network info cache due to event network-changed-34509f5f-93dd-4ba2-beac-4d1466dd853b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-05ea2717-2848-42b1-9bfa-ab01dd94970a req-f36fd00c-9664-44a6-b8b2-5001b2480a45 service nova] Acquiring lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-05ea2717-2848-42b1-9bfa-ab01dd94970a req-f36fd00c-9664-44a6-b8b2-5001b2480a45 service nova] Acquired lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-05ea2717-2848-42b1-9bfa-ab01dd94970a req-f36fd00c-9664-44a6-b8b2-5001b2480a45 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Refreshing network info cache for port 34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json" returned: 0 in 0.443s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'flavor' on Instance uuid 51963042-c0c7-4cda-8700-3de6115b9e09 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:20 user nova-compute[73007]: INFO nova.compute.manager [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Attaching volume 496ab7e4-e41c-43cb-99b0-2138d558274c to /dev/vdb
Aug 15 18:05:20 user nova-compute[73007]: DEBUG os_brick.utils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-772cd581-79fa-4757-b5ea-8275f34f4c09 req-54624131-4762-453f-95fc-7085d63d4641 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updated VIF entry in instance network info cache for port 09b2d2bf-f241-4f89-ad13-1df13d27f1fc. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-772cd581-79fa-4757-b5ea-8275f34f4c09 req-54624131-4762-453f-95fc-7085d63d4641 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updating instance_info_cache with network_info: [{"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0f558b-74b1-4899-aeb0-2993440c51db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-772cd581-79fa-4757-b5ea-8275f34f4c09 req-54624131-4762-453f-95fc-7085d63d4641 service nova] Releasing lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1f6a9c-d087-460b-922a-12c0256f75e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ee965a-dea6-4f4e-a180-d11aad5c8a18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f709f4b3-69da-4ad3-b4ff-d2440689932c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:05:20 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb9753f-03df-46af-b5b4-a9df6aec9deb]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG os_brick.utils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updating existing volume attachment record: cfbebb76-22d1-4c01-a597-02f0f323c286 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-05ea2717-2848-42b1-9bfa-ab01dd94970a req-f36fd00c-9664-44a6-b8b2-5001b2480a45 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updated VIF entry in instance network info cache for port 34509f5f-93dd-4ba2-beac-4d1466dd853b. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-05ea2717-2848-42b1-9bfa-ab01dd94970a req-f36fd00c-9664-44a6-b8b2-5001b2480a45 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updating instance_info_cache with network_info: [{"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-05ea2717-2848-42b1-9bfa-ab01dd94970a req-f36fd00c-9664-44a6-b8b2-5001b2480a45 service nova] Releasing lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:05:21 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:05:21 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7022MB free_disk=24.750553131103516GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Applying migration context for instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd as it has an incoming, in-progress migration 889ffed9-7244-4055-baa4-000154bb6933. Migration status is finished {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 18:05:21 user nova-compute[73007]: INFO nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating resource usage from migration 889ffed9-7244-4055-baa4-000154bb6933
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance da287ce9-0600-43be-94aa-038eb1edaf07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5d29f229-4024-4a0e-b18a-b7a79de8c583 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6545b6a7-4c0e-4d97-8c98-7491292c566a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e80a756d-ec14-417e-8164-a1e9db7041d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 51963042-c0c7-4cda-8700-3de6115b9e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Migration 889ffed9-7244-4055-baa4-000154bb6933 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance ce363491-dc11-4d56-ad55-c675bfdae1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:05:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:05:22 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:05:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:05:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:05:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.730s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:05:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:05:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:05:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:05:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Creating image(s)
Aug 15 18:05:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 18:05:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Ensure instance console log exists: /opt/stack/data/nova/instances/ce363491-dc11-4d56-ad55-c675bfdae1b8/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:05:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Start _get_guest_xml network_info=[{"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScgaLiJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce363491-dc11-4d56-ad55-c675bfdae1b8', 'attached_at': '', 'detached_at': '', 'volume_id': '4bd3bfbd-3a85-4b3c-815a-74040b1143fc', 'serial': '4bd3bfbd-3a85-4b3c-815a-74040b1143fc'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ce3a47cc-d35e-4403-8b43-39b862022a64', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:05:26 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:05:26 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:05:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:05:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScgaLiJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:05:27 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:05:27 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:05:27 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[552e4ced-627e-4633-a7d9-4b6bc8adba16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:05:27 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6428fb5-ed67-40b7-aea4-83394ddddfb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc] added
Aug 15 18:05:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[657eefb7-9b17-4633-845d-f09138f17eac]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc826aab-4502-479e-a06a-3b079771d36a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScgaLiJY {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ScgaLiJY" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeeee9a-68f3-4b10-8f31-438d1c698028]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ScgaLiJY'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[38272470-dd55-42b7-bd4b-863cc5a4d12f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[704c60f3-2eb9-4f5e-85b9-9093a8f4f7f4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c98e2be-f81d-4bc0-ae7b-147dc5d4a528]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc, portal: 172.16.0.220,3260]
Aug 15 18:05:27 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc, portal: 172.16.0.220,3260] successful.
Aug 15 18:05:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bdc123-6abe-4f7d-a0b2-014afaf1b92d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c724c-5f14-4e5f-839d-aac8a06fa469]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:27 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:27 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] HCTL ('39', '-', '-', 0) found on session 55 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a02b96c-a40d-4cab-ab97-859bb43e5915]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:27 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 55 and hctl ['39', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Searching for a device in session 55 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScgaLiJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26332333736616365', 'path': '/dev/sdh'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332333736616365', 'path': '/dev/sdh'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998509742',display_name='tempest-TestVolumeBootPattern-server-1998509742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998509742',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-01o0x91q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:05:16Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=ce363491-dc11-4d56-ad55-c675bfdae1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f5:5c,bridge_name='br-int',has_traffic_filtering=True,id=09b2d2bf-f241-4f89-ad13-1df13d27f1fc,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b2d2bf-f2') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.objects.instance [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'pci_devices' on Instance uuid ce363491-dc11-4d56-ad55-c675bfdae1b8 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:05:28 user nova-compute[73007]:   <uuid>ce363491-dc11-4d56-ad55-c675bfdae1b8</uuid>
Aug 15 18:05:28 user nova-compute[73007]:   <name>instance-0000002e</name>
Aug 15 18:05:28 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:05:28 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:05:28 user nova-compute[73007]:   <metadata>
Aug 15 18:05:28 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:05:28 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:05:28 user nova-compute[73007]:       <nova:name>tempest-TestVolumeBootPattern-server-1998509742</nova:name>
Aug 15 18:05:28 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:05:26</nova:creationTime>
Aug 15 18:05:28 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:05:28 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:05:28 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:05:28 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:05:28 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:05:28 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:05:28 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:05:28 user nova-compute[73007]:       <nova:owner>
Aug 15 18:05:28 user nova-compute[73007]:         <nova:user uuid="4cd910b3e8bf406f8512b3470f6eaca5">tempest-TestVolumeBootPattern-393609756-project-member</nova:user>
Aug 15 18:05:28 user nova-compute[73007]:         <nova:project uuid="c6eebca3ef0a45788b0dfbc03b01fe8c">tempest-TestVolumeBootPattern-393609756</nova:project>
Aug 15 18:05:28 user nova-compute[73007]:       </nova:owner>
Aug 15 18:05:28 user nova-compute[73007]:       <nova:ports>
Aug 15 18:05:28 user nova-compute[73007]:         <nova:port uuid="09b2d2bf-f241-4f89-ad13-1df13d27f1fc">
Aug 15 18:05:28 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 18:05:28 user nova-compute[73007]:         </nova:port>
Aug 15 18:05:28 user nova-compute[73007]:       </nova:ports>
Aug 15 18:05:28 user nova-compute[73007]:     </nova:instance>
Aug 15 18:05:28 user nova-compute[73007]:   </metadata>
Aug 15 18:05:28 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:05:28 user nova-compute[73007]:     <system>
Aug 15 18:05:28 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:05:28 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:05:28 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:05:28 user nova-compute[73007]:       <entry name="serial">ce363491-dc11-4d56-ad55-c675bfdae1b8</entry>
Aug 15 18:05:28 user nova-compute[73007]:       <entry name="uuid">ce363491-dc11-4d56-ad55-c675bfdae1b8</entry>
Aug 15 18:05:28 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:05:28 user nova-compute[73007]:     </system>
Aug 15 18:05:28 user nova-compute[73007]:   </sysinfo>
Aug 15 18:05:28 user nova-compute[73007]:   <os>
Aug 15 18:05:28 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:05:28 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:05:28 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:05:28 user nova-compute[73007]:   </os>
Aug 15 18:05:28 user nova-compute[73007]:   <features>
Aug 15 18:05:28 user nova-compute[73007]:     <acpi/>
Aug 15 18:05:28 user nova-compute[73007]:     <apic/>
Aug 15 18:05:28 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:05:28 user nova-compute[73007]:   </features>
Aug 15 18:05:28 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:05:28 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:05:28 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:05:28 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:05:28 user nova-compute[73007]:   </clock>
Aug 15 18:05:28 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:05:28 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:05:28 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:05:28 user nova-compute[73007]:   </cpu>
Aug 15 18:05:28 user nova-compute[73007]:   <devices>
Aug 15 18:05:28 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:05:28 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:05:28 user nova-compute[73007]:       <source dev="/dev/sdh"/>
Aug 15 18:05:28 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:05:28 user nova-compute[73007]:       <serial>4bd3bfbd-3a85-4b3c-815a-74040b1143fc</serial>
Aug 15 18:05:28 user nova-compute[73007]:     </disk>
Aug 15 18:05:28 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:05:28 user nova-compute[73007]:       <mac address="fa:16:3e:bc:f5:5c"/>
Aug 15 18:05:28 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:05:28 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:05:28 user nova-compute[73007]:       <target dev="tap09b2d2bf-f2"/>
Aug 15 18:05:28 user nova-compute[73007]:     </interface>
Aug 15 18:05:28 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:05:28 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/ce363491-dc11-4d56-ad55-c675bfdae1b8/console.log" append="off"/>
Aug 15 18:05:28 user nova-compute[73007]:     </serial>
Aug 15 18:05:28 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:05:28 user nova-compute[73007]:     <video>
Aug 15 18:05:28 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:05:28 user nova-compute[73007]:     </video>
Aug 15 18:05:28 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:05:28 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:05:28 user nova-compute[73007]:     </rng>
Aug 15 18:05:28 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:05:28 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:05:28 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:05:28 user nova-compute[73007]:     </memballoon>
Aug 15 18:05:28 user nova-compute[73007]:   </devices>
Aug 15 18:05:28 user nova-compute[73007]: </domain>
Aug 15 18:05:28 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998509742',display_name='tempest-TestVolumeBootPattern-server-1998509742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998509742',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-01o0x91q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:05:16Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=ce363491-dc11-4d56-ad55-c675bfdae1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f5:5c,bridge_name='br-int',has_traffic_filtering=True,id=09b2d2bf-f241-4f89-ad13-1df13d27f1fc,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b2d2bf-f2') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG os_vif [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f5:5c,bridge_name='br-int',has_traffic_filtering=True,id=09b2d2bf-f241-4f89-ad13-1df13d27f1fc,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b2d2bf-f2') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09b2d2bf-f2, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09b2d2bf-f2, col_values=(('external_ids', {'iface-id': '09b2d2bf-f241-4f89-ad13-1df13d27f1fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:f5:5c', 'vm-uuid': 'ce363491-dc11-4d56-ad55-c675bfdae1b8'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:28 user nova-compute[73007]: INFO os_vif [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f5:5c,bridge_name='br-int',has_traffic_filtering=True,id=09b2d2bf-f241-4f89-ad13-1df13d27f1fc,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b2d2bf-f2')
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:05:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] No VIF found with MAC fa:16:3e:bc:f5:5c, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:05:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-e4d0c187-a867-486c-8143-fef7f55249a9 req-8b19c954-ecd8-4f5a-a3b1-e26a3f51f310 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e4d0c187-a867-486c-8143-fef7f55249a9 req-8b19c954-ecd8-4f5a-a3b1-e26a3f51f310 service nova] Acquiring lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e4d0c187-a867-486c-8143-fef7f55249a9 req-8b19c954-ecd8-4f5a-a3b1-e26a3f51f310 service nova] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e4d0c187-a867-486c-8143-fef7f55249a9 req-8b19c954-ecd8-4f5a-a3b1-e26a3f51f310 service nova] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-e4d0c187-a867-486c-8143-fef7f55249a9 req-8b19c954-ecd8-4f5a-a3b1-e26a3f51f310 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] No waiting events found dispatching network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:05:30 user nova-compute[73007]: WARNING nova.compute.manager [req-e4d0c187-a867-486c-8143-fef7f55249a9 req-8b19c954-ecd8-4f5a-a3b1-e26a3f51f310 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received unexpected event network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc for instance with vm_state building and task_state spawning.
Aug 15 18:05:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vpKOCuJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:05:30 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:05:30 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:05:30 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d42de48-b92a-48f0-b54c-e6e0f4b339b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:05:30 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[85414029-77d0-4841-ad98-a6c63a59e471]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c] added
Aug 15 18:05:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326bbc8-224a-4cbc-8da8-ee929032aa2c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae95235c-8598-4642-93af-a1825792a47d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vpKOCuJH {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vpKOCuJH" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d571d17e-9008-4a17-ae95-ee1435ebdd82]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vpKOCuJH'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ea76d-135a-484e-bf4f-9e22fc719eb7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[61953257-6dcb-49df-a576-6bafd60b592f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:30 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:05:30 user nova-compute[73007]: INFO nova.compute.claims [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Claim successful on node user
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --login" returned: 0 in 0.127s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf9a9b-9b1c-4f20-91ff-f79a001d3b23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c, portal: 172.16.0.220,3260]
Aug 15 18:05:30 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c, portal: 172.16.0.220,3260] successful.
Aug 15 18:05:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab82926-2caa-4906-9ed9-ffed2af64450]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb5f89c-f53a-418d-bd70-a195b8055dd2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c (non-flash)
Aug 15 18:05:31 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:31 user nova-compute[73007]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c (non-flash)
Aug 15 18:05:31 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] HCTL ('40', '-', '-', 0) found on session 56 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac16def-458d-4733-b51e-327383b9d8fd]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Searching for a device in session 56 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vpKOCuJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:05:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:05:31 user nova-compute[73007]: INFO nova.virt.block_device [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Booting with volume c1c65230-5aae-4b4f-9515-f77dabf8fcce at /dev/vda
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.policy [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e603d59405784668a5e1e1fa8d5ea8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005b9f27d3394fe78f7998562bc76e7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.utils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[854eea81-184d-4cee-9322-5d6f1c12a79a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec94ddf-6467-47dd-b74e-c3c1b1b43070]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3aeb54-c82e-4667-931f-115248cd926f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[77266958-0b28-4f40-bc9b-3a389be863cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:05:31 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:05:31 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73293e6d-e14e-4526-a36c-a9ccec21a518]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG os_brick.utils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating existing volume attachment record: dade55f2-a554-4180-baee-d23e760ae9fa {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122731.9748714, ce363491-dc11-4d56-ad55-c675bfdae1b8 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:05:31 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] VM Resumed (Lifecycle Event)
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:05:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Instance spawned successfully.
Aug 15 18:05:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23934653936306664', 'path': '/dev/sdi'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934653936306664', 'path': '/dev/sdi'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:05:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122731.9757419, ce363491-dc11-4d56-ad55-c675bfdae1b8 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:05:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] VM Started (Lifecycle Event)
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'flavor' on Instance uuid 51963042-c0c7-4cda-8700-3de6115b9e09 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:05:32 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:05:32 user nova-compute[73007]:   <source dev="/dev/sdi"/>
Aug 15 18:05:32 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:05:32 user nova-compute[73007]:   <serial>496ab7e4-e41c-43cb-99b0-2138d558274c</serial>
Aug 15 18:05:32 user nova-compute[73007]: </disk>
Aug 15 18:05:32 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-5eaeb627-24d7-49fc-882d-d951f35e7312 req-41b63d59-a523-4235-b63e-21236a740718 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5eaeb627-24d7-49fc-882d-d951f35e7312 req-41b63d59-a523-4235-b63e-21236a740718 service nova] Acquiring lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5eaeb627-24d7-49fc-882d-d951f35e7312 req-41b63d59-a523-4235-b63e-21236a740718 service nova] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5eaeb627-24d7-49fc-882d-d951f35e7312 req-41b63d59-a523-4235-b63e-21236a740718 service nova] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.compute.manager [req-5eaeb627-24d7-49fc-882d-d951f35e7312 req-41b63d59-a523-4235-b63e-21236a740718 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] No waiting events found dispatching network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:05:32 user nova-compute[73007]: WARNING nova.compute.manager [req-5eaeb627-24d7-49fc-882d-d951f35e7312 req-41b63d59-a523-4235-b63e-21236a740718 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received unexpected event network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc for instance with vm_state building and task_state spawning.
Aug 15 18:05:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:05:32 user nova-compute[73007]: INFO nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Took 5.18 seconds to spawn the instance on the hypervisor.
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:05:32 user nova-compute[73007]: INFO nova.compute.manager [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Took 16.98 seconds to build instance.
Aug 15 18:05:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d49d6f58-fc86-4149-9a83-ddcdb38a47ad tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.152s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Successfully created port: 70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] No VIF found with MAC fa:16:3e:f9:38:5b, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:05:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6ab6f8eb-afa6-4dbc-a8ab-d910391c4bfe tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.366s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Successfully updated port: 70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-605b180c-c3b5-406e-ae42-a349fff823ca req-4c0ea8e9-8d57-4d6e-a41d-f34d792fce73 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-605b180c-c3b5-406e-ae42-a349fff823ca req-4c0ea8e9-8d57-4d6e-a41d-f34d792fce73 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing instance network info cache due to event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-605b180c-c3b5-406e-ae42-a349fff823ca req-4c0ea8e9-8d57-4d6e-a41d-f34d792fce73 service nova] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance network_info: |[{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-605b180c-c3b5-406e-ae42-a349fff823ca req-4c0ea8e9-8d57-4d6e-a41d-f34d792fce73 service nova] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:05:33 user nova-compute[73007]: DEBUG nova.network.neutron [req-605b180c-c3b5-406e-ae42-a349fff823ca req-4c0ea8e9-8d57-4d6e-a41d-f34d792fce73 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:05:34 user nova-compute[73007]: DEBUG nova.network.neutron [req-605b180c-c3b5-406e-ae42-a349fff823ca req-4c0ea8e9-8d57-4d6e-a41d-f34d792fce73 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updated VIF entry in instance network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:05:34 user nova-compute[73007]: DEBUG nova.network.neutron [req-605b180c-c3b5-406e-ae42-a349fff823ca req-4c0ea8e9-8d57-4d6e-a41d-f34d792fce73 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:05:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-605b180c-c3b5-406e-ae42-a349fff823ca req-4c0ea8e9-8d57-4d6e-a41d-f34d792fce73 service nova] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:05:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:34 user nova-compute[73007]: INFO nova.compute.manager [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Detaching volume 496ab7e4-e41c-43cb-99b0-2138d558274c
Aug 15 18:05:34 user nova-compute[73007]: INFO nova.virt.block_device [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Attempting to driver detach volume 496ab7e4-e41c-43cb-99b0-2138d558274c from mountpoint /dev/vdb
Aug 15 18:05:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Attempting to detach device vdb from instance 51963042-c0c7-4cda-8700-3de6115b9e09 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:05:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:05:34 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:05:34 user nova-compute[73007]:   <source dev="/dev/sdi"/>
Aug 15 18:05:34 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:05:34 user nova-compute[73007]:   <serial>496ab7e4-e41c-43cb-99b0-2138d558274c</serial>
Aug 15 18:05:34 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:05:34 user nova-compute[73007]: </disk>
Aug 15 18:05:34 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:05:34 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Successfully detached device vdb from instance 51963042-c0c7-4cda-8700-3de6115b9e09 from the persistent domain config.
Aug 15 18:05:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51963042-c0c7-4cda-8700-3de6115b9e09 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:05:34 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:05:34 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:05:34 user nova-compute[73007]:   <source dev="/dev/sdi"/>
Aug 15 18:05:34 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:05:34 user nova-compute[73007]:   <serial>496ab7e4-e41c-43cb-99b0-2138d558274c</serial>
Aug 15 18:05:34 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:05:34 user nova-compute[73007]: </disk>
Aug 15 18:05:34 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122735.1095161, 51963042-c0c7-4cda-8700-3de6115b9e09 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51963042-c0c7-4cda-8700-3de6115b9e09 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:05:35 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Successfully detached device vdb from instance 51963042-c0c7-4cda-8700-3de6115b9e09 from the live domain config.
Aug 15 18:05:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vpKOCuJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:05:35 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c27a42e-8a03-461c-8f85-8a7aaaa073d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d144611-b82f-4cee-861d-898aeb55052c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c (non-flash)
Aug 15 18:05:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:35 user nova-compute[73007]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c (non-flash)
Aug 15 18:05:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c607eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c'): ({'sdi'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Removing single pathed devices sdi {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a9b7a1-bca4-4ab2-bb42-fba6678967d0]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69ce912-472f-4fc4-a9e5-c160d9ac8da3]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Flushing IO for device /dev/sdi {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[01655ace-b1e4-4202-92f5-c27b6e67c897]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f20d633-5371-4d9c-9d7d-fa12f0c80c3b]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] SCSI volumes sdi have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[52010700-69f3-4943-85fb-b13b351d5c25]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[23796f5a-b2ff-4800-b796-7935f6177865]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c, portal: 172.16.0.220,3260]
Aug 15 18:05:35 user nova-compute[73007]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c, portal: 172.16.0.220,3260] successful.
Aug 15 18:05:35 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:496ab7e4-e41c-43cb-99b0-2138d558274c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d3efcc-5811-437a-b97e-ccd22d8fccbb]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] <== disconnect_volume: return (350ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:05:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:05:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'flavor' on Instance uuid 51963042-c0c7-4cda-8700-3de6115b9e09 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:05:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-834d4395-95cd-4315-b904-cc823af16e44 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:05:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Creating image(s)
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Ensure instance console log exists: /opt/stack/data/nova/instances/3cb91142-7140-45a7-8f42-d515c7ffb158/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Start _get_guest_xml network_info=[{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFRPpDqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3cb91142-7140-45a7-8f42-d515c7ffb158', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1c65230-5aae-4b4f-9515-f77dabf8fcce', 'serial': 'c1c65230-5aae-4b4f-9515-f77dabf8fcce'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'dade55f2-a554-4180-baee-d23e760ae9fa', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:05:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:05:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFRPpDqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:05:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:05:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:05:42 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dadaa2-cd61-4624-9325-42bd76dc5e4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:05:42 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ade9af7-5ef1-4fe8-bad3-4aa584cbce21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce] added
Aug 15 18:05:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9214a56f-0c62-4dd4-8982-f551eddb2d0c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a580337-b4b3-4742-aaf8-eaacbcec3417]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFRPpDqz {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFRPpDqz" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[69169bc4-3065-45a8-9b4e-c3a3d4ec270f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SFRPpDqz'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[17705f4f-a585-4163-a96c-b2c9834b6836]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d3aade-d5f6-4b94-ba11-79828c44d202]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c086a-04c9-445d-899d-3ad755d232b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260]
Aug 15 18:05:42 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260] successful.
Aug 15 18:05:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e597c8-d598-4729-b9a5-1c4b3bbf8ee1]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[41633213-19b8-4b7b-ab20-745ce0861dbc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:05:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:05:42 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:05:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] HCTL ('40', '-', '-', 0) found on session 57 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea71f2-060a-4f76-bedf-8681f4d7173f]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Searching for a device in session 57 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:05:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFRPpDqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23861363231356631', 'path': '/dev/sdi'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861363231356631', 'path': '/dev/sdi'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1555420845',display_name='tempest-TestShelveInstance-server-1555420845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1555420845',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Uy7J7kEGqI576s+LbH3MCZFhYymIIQh/NtmKCy09E5kh0EHjfLzTqoLSdwzJFvliG8DKTbZV+03bDKw2UhygRVGqzr+pdlg/XGYzPaUKs0lz1NfTKG51DZvT04CCY3A==',key_name='tempest-TestShelveInstance-249784429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='005b9f27d3394fe78f7998562bc76e7f',ramdisk_id='',reservation_id='r-mf3ssg2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1310135125',owner_user_name='tempest-TestShelveInstance-1310135125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:05:32Z,user_data=None,user_id='e603d59405784668a5e1e1fa8d5ea8d0',uuid=3cb91142-7140-45a7-8f42-d515c7ffb158,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converting VIF {"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:05:43 user nova-compute[73007]:   <uuid>3cb91142-7140-45a7-8f42-d515c7ffb158</uuid>
Aug 15 18:05:43 user nova-compute[73007]:   <name>instance-0000002f</name>
Aug 15 18:05:43 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:05:43 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:05:43 user nova-compute[73007]:   <metadata>
Aug 15 18:05:43 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:05:43 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:05:43 user nova-compute[73007]:       <nova:name>tempest-TestShelveInstance-server-1555420845</nova:name>
Aug 15 18:05:43 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:05:42</nova:creationTime>
Aug 15 18:05:43 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:05:43 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:05:43 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:05:43 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:05:43 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:05:43 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:05:43 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:05:43 user nova-compute[73007]:       <nova:owner>
Aug 15 18:05:43 user nova-compute[73007]:         <nova:user uuid="e603d59405784668a5e1e1fa8d5ea8d0">tempest-TestShelveInstance-1310135125-project-member</nova:user>
Aug 15 18:05:43 user nova-compute[73007]:         <nova:project uuid="005b9f27d3394fe78f7998562bc76e7f">tempest-TestShelveInstance-1310135125</nova:project>
Aug 15 18:05:43 user nova-compute[73007]:       </nova:owner>
Aug 15 18:05:43 user nova-compute[73007]:       <nova:ports>
Aug 15 18:05:43 user nova-compute[73007]:         <nova:port uuid="70d465d4-7680-4c97-bdd8-06f77e426e2f">
Aug 15 18:05:43 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 18:05:43 user nova-compute[73007]:         </nova:port>
Aug 15 18:05:43 user nova-compute[73007]:       </nova:ports>
Aug 15 18:05:43 user nova-compute[73007]:     </nova:instance>
Aug 15 18:05:43 user nova-compute[73007]:   </metadata>
Aug 15 18:05:43 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:05:43 user nova-compute[73007]:     <system>
Aug 15 18:05:43 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:05:43 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:05:43 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:05:43 user nova-compute[73007]:       <entry name="serial">3cb91142-7140-45a7-8f42-d515c7ffb158</entry>
Aug 15 18:05:43 user nova-compute[73007]:       <entry name="uuid">3cb91142-7140-45a7-8f42-d515c7ffb158</entry>
Aug 15 18:05:43 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:05:43 user nova-compute[73007]:     </system>
Aug 15 18:05:43 user nova-compute[73007]:   </sysinfo>
Aug 15 18:05:43 user nova-compute[73007]:   <os>
Aug 15 18:05:43 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:05:43 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:05:43 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:05:43 user nova-compute[73007]:   </os>
Aug 15 18:05:43 user nova-compute[73007]:   <features>
Aug 15 18:05:43 user nova-compute[73007]:     <acpi/>
Aug 15 18:05:43 user nova-compute[73007]:     <apic/>
Aug 15 18:05:43 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:05:43 user nova-compute[73007]:   </features>
Aug 15 18:05:43 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:05:43 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:05:43 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:05:43 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:05:43 user nova-compute[73007]:   </clock>
Aug 15 18:05:43 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:05:43 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:05:43 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:05:43 user nova-compute[73007]:   </cpu>
Aug 15 18:05:43 user nova-compute[73007]:   <devices>
Aug 15 18:05:43 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:05:43 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:05:43 user nova-compute[73007]:       <source dev="/dev/sdi"/>
Aug 15 18:05:43 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:05:43 user nova-compute[73007]:       <serial>c1c65230-5aae-4b4f-9515-f77dabf8fcce</serial>
Aug 15 18:05:43 user nova-compute[73007]:     </disk>
Aug 15 18:05:43 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:05:43 user nova-compute[73007]:       <mac address="fa:16:3e:bb:1b:bd"/>
Aug 15 18:05:43 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:05:43 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:05:43 user nova-compute[73007]:       <target dev="tap70d465d4-76"/>
Aug 15 18:05:43 user nova-compute[73007]:     </interface>
Aug 15 18:05:43 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:05:43 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/3cb91142-7140-45a7-8f42-d515c7ffb158/console.log" append="off"/>
Aug 15 18:05:43 user nova-compute[73007]:     </serial>
Aug 15 18:05:43 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:05:43 user nova-compute[73007]:     <video>
Aug 15 18:05:43 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:05:43 user nova-compute[73007]:     </video>
Aug 15 18:05:43 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:05:43 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:05:43 user nova-compute[73007]:     </rng>
Aug 15 18:05:43 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:05:43 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:05:43 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:05:43 user nova-compute[73007]:     </memballoon>
Aug 15 18:05:43 user nova-compute[73007]:   </devices>
Aug 15 18:05:43 user nova-compute[73007]: </domain>
Aug 15 18:05:43 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1555420845',display_name='tempest-TestShelveInstance-server-1555420845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1555420845',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Uy7J7kEGqI576s+LbH3MCZFhYymIIQh/NtmKCy09E5kh0EHjfLzTqoLSdwzJFvliG8DKTbZV+03bDKw2UhygRVGqzr+pdlg/XGYzPaUKs0lz1NfTKG51DZvT04CCY3A==',key_name='tempest-TestShelveInstance-249784429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='005b9f27d3394fe78f7998562bc76e7f',ramdisk_id='',reservation_id='r-mf3ssg2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1310135125',owner_user_name='tempest-TestShelveInstance-1310135125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:05:32Z,user_data=None,user_id='e603d59405784668a5e1e1fa8d5ea8d0',uuid=3cb91142-7140-45a7-8f42-d515c7ffb158,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converting VIF {"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG os_vif [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d465d4-76, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70d465d4-76, col_values=(('external_ids', {'iface-id': '70d465d4-7680-4c97-bdd8-06f77e426e2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:1b:bd', 'vm-uuid': '3cb91142-7140-45a7-8f42-d515c7ffb158'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:43 user nova-compute[73007]: INFO os_vif [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76')
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:05:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] No VIF found with MAC fa:16:3e:bb:1b:bd, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:05:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-2e191067-6333-4d79-bbcf-17607c3035d0 req-30b0c89d-63ac-4549-b9df-e9c0c93c2b44 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2e191067-6333-4d79-bbcf-17607c3035d0 req-30b0c89d-63ac-4549-b9df-e9c0c93c2b44 service nova] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2e191067-6333-4d79-bbcf-17607c3035d0 req-30b0c89d-63ac-4549-b9df-e9c0c93c2b44 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2e191067-6333-4d79-bbcf-17607c3035d0 req-30b0c89d-63ac-4549-b9df-e9c0c93c2b44 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG nova.compute.manager [req-2e191067-6333-4d79-bbcf-17607c3035d0 req-30b0c89d-63ac-4549-b9df-e9c0c93c2b44 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] No waiting events found dispatching network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:05:45 user nova-compute[73007]: WARNING nova.compute.manager [req-2e191067-6333-4d79-bbcf-17607c3035d0 req-30b0c89d-63ac-4549-b9df-e9c0c93c2b44 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received unexpected event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f for instance with vm_state building and task_state spawning.
Aug 15 18:05:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122747.140878, 3cb91142-7140-45a7-8f42-d515c7ffb158 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:05:47 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] VM Resumed (Lifecycle Event)
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:05:47 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance spawned successfully.
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:05:47 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122747.1422706, 3cb91142-7140-45a7-8f42-d515c7ffb158 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:05:47 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] VM Started (Lifecycle Event)
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:05:47 user nova-compute[73007]: INFO nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Took 5.07 seconds to spawn the instance on the hypervisor.
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:05:47 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:05:47 user nova-compute[73007]: INFO nova.compute.manager [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Took 16.53 seconds to build instance.
Aug 15 18:05:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c5c1ade6-7ca6-412c-b3f0-684da1c4a2c9 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.628s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-ee5ebc11-1b85-41b9-bedb-72f2979fa834 req-93cea9e8-6cde-4806-9e43-f79cb4f112d1 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ee5ebc11-1b85-41b9-bedb-72f2979fa834 req-93cea9e8-6cde-4806-9e43-f79cb4f112d1 service nova] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ee5ebc11-1b85-41b9-bedb-72f2979fa834 req-93cea9e8-6cde-4806-9e43-f79cb4f112d1 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ee5ebc11-1b85-41b9-bedb-72f2979fa834 req-93cea9e8-6cde-4806-9e43-f79cb4f112d1 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:05:47 user nova-compute[73007]: DEBUG nova.compute.manager [req-ee5ebc11-1b85-41b9-bedb-72f2979fa834 req-93cea9e8-6cde-4806-9e43-f79cb4f112d1 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] No waiting events found dispatching network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:05:47 user nova-compute[73007]: WARNING nova.compute.manager [req-ee5ebc11-1b85-41b9-bedb-72f2979fa834 req-93cea9e8-6cde-4806-9e43-f79cb4f112d1 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received unexpected event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f for instance with vm_state active and task_state None.
Aug 15 18:05:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:05:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-36006ab8-566f-4e2f-95b5-7f7f3fc5625f req-97ad6f8f-71b9-4a62-a3eb-a5b7f3d745b4 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-36006ab8-566f-4e2f-95b5-7f7f3fc5625f req-97ad6f8f-71b9-4a62-a3eb-a5b7f3d745b4 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing instance network info cache due to event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:06:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36006ab8-566f-4e2f-95b5-7f7f3fc5625f req-97ad6f8f-71b9-4a62-a3eb-a5b7f3d745b4 service nova] Acquiring lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:06:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36006ab8-566f-4e2f-95b5-7f7f3fc5625f req-97ad6f8f-71b9-4a62-a3eb-a5b7f3d745b4 service nova] Acquired lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:06:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-36006ab8-566f-4e2f-95b5-7f7f3fc5625f req-97ad6f8f-71b9-4a62-a3eb-a5b7f3d745b4 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:06:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-36006ab8-566f-4e2f-95b5-7f7f3fc5625f req-97ad6f8f-71b9-4a62-a3eb-a5b7f3d745b4 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updated VIF entry in instance network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:06:15 user nova-compute[73007]: DEBUG nova.network.neutron [req-36006ab8-566f-4e2f-95b5-7f7f3fc5625f req-97ad6f8f-71b9-4a62-a3eb-a5b7f3d745b4 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating instance_info_cache with network_info: [{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-36006ab8-566f-4e2f-95b5-7f7f3fc5625f req-97ad6f8f-71b9-4a62-a3eb-a5b7f3d745b4 service nova] Releasing lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:06:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-529a28c5-659d-4f7c-aac8-d2fee50f142e req-0d24f02c-7c3b-492b-adfe-00c862956314 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-529a28c5-659d-4f7c-aac8-d2fee50f142e req-0d24f02c-7c3b-492b-adfe-00c862956314 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing instance network info cache due to event network-changed-6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-529a28c5-659d-4f7c-aac8-d2fee50f142e req-0d24f02c-7c3b-492b-adfe-00c862956314 service nova] Acquiring lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-529a28c5-659d-4f7c-aac8-d2fee50f142e req-0d24f02c-7c3b-492b-adfe-00c862956314 service nova] Acquired lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.network.neutron [req-529a28c5-659d-4f7c-aac8-d2fee50f142e req-0d24f02c-7c3b-492b-adfe-00c862956314 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Refreshing network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:16 user nova-compute[73007]: INFO nova.compute.manager [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Detaching volume 19dffe87-082a-483f-96c0-a21015468766
Aug 15 18:06:16 user nova-compute[73007]: INFO nova.virt.block_device [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Attempting to driver detach volume 19dffe87-082a-483f-96c0-a21015468766 from mountpoint /dev/vdb
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Attempting to detach device vdb from instance 6545b6a7-4c0e-4d97-8c98-7491292c566a from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:06:16 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:06:16 user nova-compute[73007]:   <source dev="/dev/sdg"/>
Aug 15 18:06:16 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:06:16 user nova-compute[73007]:   <serial>19dffe87-082a-483f-96c0-a21015468766</serial>
Aug 15 18:06:16 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 18:06:16 user nova-compute[73007]: </disk>
Aug 15 18:06:16 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:06:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully detached device vdb from instance 6545b6a7-4c0e-4d97-8c98-7491292c566a from the persistent domain config.
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6545b6a7-4c0e-4d97-8c98-7491292c566a from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:06:16 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:06:16 user nova-compute[73007]:   <source dev="/dev/sdg"/>
Aug 15 18:06:16 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:06:16 user nova-compute[73007]:   <serial>19dffe87-082a-483f-96c0-a21015468766</serial>
Aug 15 18:06:16 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 18:06:16 user nova-compute[73007]: </disk>
Aug 15 18:06:16 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.network.neutron [req-529a28c5-659d-4f7c-aac8-d2fee50f142e req-0d24f02c-7c3b-492b-adfe-00c862956314 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updated VIF entry in instance network info cache for port 6120a809-279a-4cb4-b7d7-17da5e39273f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.network.neutron [req-529a28c5-659d-4f7c-aac8-d2fee50f142e req-0d24f02c-7c3b-492b-adfe-00c862956314 service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating instance_info_cache with network_info: [{"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-529a28c5-659d-4f7c-aac8-d2fee50f142e req-0d24f02c-7c3b-492b-adfe-00c862956314 service nova] Releasing lock "refresh_cache-6545b6a7-4c0e-4d97-8c98-7491292c566a" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122776.7390075, 6545b6a7-4c0e-4d97-8c98-7491292c566a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:06:16 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully detached device vdb from instance 6545b6a7-4c0e-4d97-8c98-7491292c566a from the live domain config.
Aug 15 18:06:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUJqYkZQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:06:16 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8924dd-6d0f-4b44-8894-3f336a7b624a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b02218-3b63-41b0-ad87-b867c7ed153c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:06:16 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:06:16 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:06:16 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c4665f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766'): ({'sdg'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Removing single pathed devices sdg {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3e6bef-6c96-4f22-9d7f-265b45999bf5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e45816-93e8-47f3-baf6-1518d2342f52]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flushing IO for device /dev/sdg {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb189a61-02e0-4d50-86eb-ca7fd9bc0b52]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ed21e4-5d7f-473b-9a08-fd494d3749d8]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] SCSI volumes sdg have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee36c54-0104-4ee5-a2db-4a9f0146c076]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f231c-1f0f-48dc-bb25-b36e657f3aa6]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260]
Aug 15 18:06:17 user nova-compute[73007]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766, portal: 172.16.0.220,3260] successful.
Aug 15 18:06:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dffe87-082a-483f-96c0-a21015468766 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4dd1ab-ac55-4d81-bdb0-30bf48f6cdc0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] <== disconnect_volume: return (302ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [{"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-accaba3e-7f1d-4638-8338-453f429a0c40" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Going to confirm migration 2 {{(pid=73007) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'flavor' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:06:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3652efd6-37d9-45c5-831a-f87da09ffab5 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.682s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquired lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'info_cache' on Instance uuid 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-eeed1a71-b54d-43ed-ac04-28e70633ec90 req-e0e52e13-f54d-42ca-8444-6a1d8d20f90d service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-changed-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-eeed1a71-b54d-43ed-ac04-28e70633ec90 req-e0e52e13-f54d-42ca-8444-6a1d8d20f90d service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Refreshing instance network info cache due to event network-changed-f98c5145-23fc-4228-bf00-2a399bb280f0. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-eeed1a71-b54d-43ed-ac04-28e70633ec90 req-e0e52e13-f54d-42ca-8444-6a1d8d20f90d service nova] Acquiring lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-eeed1a71-b54d-43ed-ac04-28e70633ec90 req-e0e52e13-f54d-42ca-8444-6a1d8d20f90d service nova] Acquired lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG nova.network.neutron [req-eeed1a71-b54d-43ed-ac04-28e70633ec90 req-e0e52e13-f54d-42ca-8444-6a1d8d20f90d service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Refreshing network info cache for port f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating instance_info_cache with network_info: [{"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Releasing lock "refresh_cache-693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'migration_context' on Instance uuid 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:19 user nova-compute[73007]: INFO nova.compute.manager [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Detaching volume 1b85a393-a180-43dc-8cc2-113aa2cc6fa4
Aug 15 18:06:19 user nova-compute[73007]: INFO nova.virt.block_device [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Attempting to driver detach volume 1b85a393-a180-43dc-8cc2-113aa2cc6fa4 from mountpoint /dev/vdb
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Attempting to detach device vdb from instance da287ce9-0600-43be-94aa-038eb1edaf07 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:06:19 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:06:19 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:06:19 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:06:19 user nova-compute[73007]:   <serial>1b85a393-a180-43dc-8cc2-113aa2cc6fa4</serial>
Aug 15 18:06:19 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:06:19 user nova-compute[73007]: </disk>
Aug 15 18:06:19 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:06:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Successfully detached device vdb from instance da287ce9-0600-43be-94aa-038eb1edaf07 from the persistent domain config.
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da287ce9-0600-43be-94aa-038eb1edaf07 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:06:19 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:06:19 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:06:19 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:06:19 user nova-compute[73007]:   <serial>1b85a393-a180-43dc-8cc2-113aa2cc6fa4</serial>
Aug 15 18:06:19 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:06:19 user nova-compute[73007]: </disk>
Aug 15 18:06:19 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-eeed1a71-b54d-43ed-ac04-28e70633ec90 req-e0e52e13-f54d-42ca-8444-6a1d8d20f90d service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updated VIF entry in instance network info cache for port f98c5145-23fc-4228-bf00-2a399bb280f0. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-eeed1a71-b54d-43ed-ac04-28e70633ec90 req-e0e52e13-f54d-42ca-8444-6a1d8d20f90d service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-eeed1a71-b54d-43ed-ac04-28e70633ec90 req-e0e52e13-f54d-42ca-8444-6a1d8d20f90d service nova] Releasing lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.725s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Deleted allocation for migration 889ffed9-7244-4055-baa4-000154bb6933
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692122779.6637378, da287ce9-0600-43be-94aa-038eb1edaf07 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:06:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Successfully detached device vdb from instance da287ce9-0600-43be-94aa-038eb1edaf07 from the live domain config.
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfytiqnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:06:19 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea00697-f0ea-4a1f-933e-6eb547e75e01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f04473f8-049a-46e0-96c5-a3a2934c6a99 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.895s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aae4059-e436-4af1-9e8d-0ca96c72d496]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:06:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:06:19 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:06:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c606b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f58271-463b-4324-92e0-9d82119967fd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef53b6d-8090-49d1-8934-04b2e052c614]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb475b6-0301-42ae-b4ed-710c428576db]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[889c7905-cef8-4267-b4ed-147c49abd665]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e681da-cec5-4787-a8ff-1ed5a4096714]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9593374f-8801-4fa7-82df-7dda4fc466bd]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4, portal: 172.16.0.220,3260]
Aug 15 18:06:19 user nova-compute[73007]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4, portal: 172.16.0.220,3260] successful.
Aug 15 18:06:19 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:06:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b85a393-a180-43dc-8cc2-113aa2cc6fa4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9ee1ec-c68b-4b93-81f0-59c234eb1876]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] <== disconnect_volume: return (346ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-c57d6098-bb03-4592-9879-3694ffaf6777 req-094c5ec0-9dc6-4a8f-a9c7-c653fdea7fd5 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-changed-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-c57d6098-bb03-4592-9879-3694ffaf6777 req-094c5ec0-9dc6-4a8f-a9c7-c653fdea7fd5 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Refreshing instance network info cache due to event network-changed-f98c5145-23fc-4228-bf00-2a399bb280f0. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c57d6098-bb03-4592-9879-3694ffaf6777 req-094c5ec0-9dc6-4a8f-a9c7-c653fdea7fd5 service nova] Acquiring lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c57d6098-bb03-4592-9879-3694ffaf6777 req-094c5ec0-9dc6-4a8f-a9c7-c653fdea7fd5 service nova] Acquired lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-c57d6098-bb03-4592-9879-3694ffaf6777 req-094c5ec0-9dc6-4a8f-a9c7-c653fdea7fd5 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Refreshing network info cache for port f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG nova.objects.instance [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'flavor' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-af38fb62-f322-460b-96dc-1e397a9987a2 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.771s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG nova.network.neutron [req-c57d6098-bb03-4592-9879-3694ffaf6777 req-094c5ec0-9dc6-4a8f-a9c7-c653fdea7fd5 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updated VIF entry in instance network info cache for port f98c5145-23fc-4228-bf00-2a399bb280f0. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG nova.network.neutron [req-c57d6098-bb03-4592-9879-3694ffaf6777 req-094c5ec0-9dc6-4a8f-a9c7-c653fdea7fd5 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [{"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c57d6098-bb03-4592-9879-3694ffaf6777 req-094c5ec0-9dc6-4a8f-a9c7-c653fdea7fd5 service nova] Releasing lock "refresh_cache-da287ce9-0600-43be-94aa-038eb1edaf07" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:06:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=6737MB free_disk=24.73871612548828GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance da287ce9-0600-43be-94aa-038eb1edaf07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5d29f229-4024-4a0e-b18a-b7a79de8c583 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 6545b6a7-4c0e-4d97-8c98-7491292c566a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e80a756d-ec14-417e-8164-a1e9db7041d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 51963042-c0c7-4cda-8700-3de6115b9e09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance ce363491-dc11-4d56-ad55-c675bfdae1b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 3cb91142-7140-45a7-8f42-d515c7ffb158 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:06:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:06:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-838b8255-c91d-4156-91f8-09d430a4fcb8 req-543590ab-2866-43f9-94a0-35ff06a4352d service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received event network-changed-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-838b8255-c91d-4156-91f8-09d430a4fcb8 req-543590ab-2866-43f9-94a0-35ff06a4352d service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Refreshing instance network info cache due to event network-changed-34509f5f-93dd-4ba2-beac-4d1466dd853b. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-838b8255-c91d-4156-91f8-09d430a4fcb8 req-543590ab-2866-43f9-94a0-35ff06a4352d service nova] Acquiring lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-838b8255-c91d-4156-91f8-09d430a4fcb8 req-543590ab-2866-43f9-94a0-35ff06a4352d service nova] Acquired lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-838b8255-c91d-4156-91f8-09d430a4fcb8 req-543590ab-2866-43f9-94a0-35ff06a4352d service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Refreshing network info cache for port 34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:25 user nova-compute[73007]: INFO nova.compute.manager [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Terminating instance
Aug 15 18:06:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-838b8255-c91d-4156-91f8-09d430a4fcb8 req-543590ab-2866-43f9-94a0-35ff06a4352d service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updated VIF entry in instance network info cache for port 34509f5f-93dd-4ba2-beac-4d1466dd853b. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-838b8255-c91d-4156-91f8-09d430a4fcb8 req-543590ab-2866-43f9-94a0-35ff06a4352d service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updating instance_info_cache with network_info: [{"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-838b8255-c91d-4156-91f8-09d430a4fcb8 req-543590ab-2866-43f9-94a0-35ff06a4352d service nova] Releasing lock "refresh_cache-51963042-c0c7-4cda-8700-3de6115b9e09" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:06:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Instance destroyed successfully.
Aug 15 18:06:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'resources' on Instance uuid 51963042-c0c7-4cda-8700-3de6115b9e09 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-711461211',display_name='tempest-TestStampPattern-server-711461211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-711461211',id=45,image_ref='4e1dd7ec-f424-4ee6-9cb7-1c63f425a7df',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Wzpkb4d/FqkLpOgMs40DkQZ4S3W/bdhb1IceHH+6YDRcBBgEJz/OwRQD9/KRHQQ/5ClKqrnorBoWo+ErrhtxAJD56iE9sp7wIWJnjhB08h2DT6wHTAeyjVek0+ZKfdQ==',key_name='tempest-TestStampPattern-319626008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:03:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9dc4bf210044c769da4afeb6fbb7607',ramdisk_id='',reservation_id='r-pdurinkj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5ed0a68e-b82d-4aa9-b7d6-01aaa573c541',image_min_disk='1',image_min_ram='0',image_owner_id='f9dc4bf210044c769da4afeb6fbb7607',image_owner_project_name='tempest-TestStampPattern-1140446429',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1140446429-project-member',image_user_id='0a4ecddd550e412e83798beb94d71db6',owner_project_name='tempest-TestStampPattern-1140446429',owner_user_name='tempest-TestStampPattern-1140446429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:03:36Z,user_data=None,user_id='0a4ecddd550e412e83798beb94d71db6',uuid=51963042-c0c7-4cda-8700-3de6115b9e09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converting VIF {"id": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "address": "fa:16:3e:f9:38:5b", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34509f5f-93", "ovs_interfaceid": "34509f5f-93dd-4ba2-beac-4d1466dd853b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:38:5b,bridge_name='br-int',has_traffic_filtering=True,id=34509f5f-93dd-4ba2-beac-4d1466dd853b,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34509f5f-93') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG os_vif [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:38:5b,bridge_name='br-int',has_traffic_filtering=True,id=34509f5f-93dd-4ba2-beac-4d1466dd853b,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34509f5f-93') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34509f5f-93, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:26 user nova-compute[73007]: INFO os_vif [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:38:5b,bridge_name='br-int',has_traffic_filtering=True,id=34509f5f-93dd-4ba2-beac-4d1466dd853b,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34509f5f-93')
Aug 15 18:06:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Deleting instance files /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09_del
Aug 15 18:06:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Deletion of /opt/stack/data/nova/instances/51963042-c0c7-4cda-8700-3de6115b9e09_del complete
Aug 15 18:06:26 user nova-compute[73007]: INFO nova.compute.manager [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 18:06:26 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:26 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Took 0.46 seconds to deallocate network for instance.
Aug 15 18:06:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-b428e3b6-1ab9-47be-82ba-7a1fc01fd000 req-28ecd1c9-6b57-4e22-8edc-b8ae832d0023 service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received event network-vif-deleted-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:27 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Deleted allocations for instance 51963042-c0c7-4cda-8700-3de6115b9e09
Aug 15 18:06:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-c4ecf6be-f3bf-44a8-a232-d77c9c6adc88 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "51963042-c0c7-4cda-8700-3de6115b9e09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.881s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received event network-vif-unplugged-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] No waiting events found dispatching network-vif-unplugged-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:06:27 user nova-compute[73007]: WARNING nova.compute.manager [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received unexpected event network-vif-unplugged-34509f5f-93dd-4ba2-beac-4d1466dd853b for instance with vm_state deleted and task_state None.
Aug 15 18:06:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received event network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] Acquiring lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] Lock "51963042-c0c7-4cda-8700-3de6115b9e09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:27 user nova-compute[73007]: DEBUG nova.compute.manager [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] No waiting events found dispatching network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:06:27 user nova-compute[73007]: WARNING nova.compute.manager [req-b97a1381-4458-41e4-8bba-54a949d5c31a req-23f60239-5838-4fec-9c91-cb231181761c service nova] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Received unexpected event network-vif-plugged-34509f5f-93dd-4ba2-beac-4d1466dd853b for instance with vm_state deleted and task_state None.
Aug 15 18:06:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122786.0912037, 51963042-c0c7-4cda-8700-3de6115b9e09 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:06:41 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] VM Stopped (Lifecycle Event)
Aug 15 18:06:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6c4d0bd9-2b77-43d5-b202-2a1413b0fe30 None None] [instance: 51963042-c0c7-4cda-8700-3de6115b9e09] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:41 user nova-compute[73007]: INFO nova.compute.manager [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Terminating instance
Aug 15 18:06:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-e2021713-cdbf-4415-be7b-7364b979cd78 req-6d39659e-7ba9-432d-97af-fb23154a1e2d service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e2021713-cdbf-4415-be7b-7364b979cd78 req-6d39659e-7ba9-432d-97af-fb23154a1e2d service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e2021713-cdbf-4415-be7b-7364b979cd78 req-6d39659e-7ba9-432d-97af-fb23154a1e2d service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e2021713-cdbf-4415-be7b-7364b979cd78 req-6d39659e-7ba9-432d-97af-fb23154a1e2d service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-e2021713-cdbf-4415-be7b-7364b979cd78 req-6d39659e-7ba9-432d-97af-fb23154a1e2d service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG nova.compute.manager [req-e2021713-cdbf-4415-be7b-7364b979cd78 req-6d39659e-7ba9-432d-97af-fb23154a1e2d service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-unplugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:06:42 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Instance destroyed successfully.
Aug 15 18:06:42 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'resources' on Instance uuid 5d29f229-4024-4a0e-b18a-b7a79de8c583 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-329861494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-329861494',id=40,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:03:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-tw4g3u07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:04:56Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=5d29f229-4024-4a0e-b18a-b7a79de8c583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "address": "fa:16:3e:8f:a4:96", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f852c51-08", "ovs_interfaceid": "1f852c51-0895-4cf3-8fd9-a5b266f8166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=1f852c51-0895-4cf3-8fd9-a5b266f8166b,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f852c51-08') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_vif [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=1f852c51-0895-4cf3-8fd9-a5b266f8166b,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f852c51-08') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f852c51-08, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:06:42 user nova-compute[73007]: INFO os_vif [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a4:96,bridge_name='br-int',has_traffic_filtering=True,id=1f852c51-0895-4cf3-8fd9-a5b266f8166b,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f852c51-08')
Aug 15 18:06:42 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtzdoGHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:06:42 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e5aaa5-aa47-41be-b013-216bf63f7a4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d558e7-8b41-4d22-8356-a9e4f65055eb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:06:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:06:42 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:06:42 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11505716c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b'): ({'sdd'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Removing single pathed devices sdd {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b07e2a-49ab-46d0-aa11-c31793a7ea66]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1effd9b-c560-4767-a8ca-b4326b8a6dbf]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flushing IO for device /dev/sdd {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef51fc1e-f364-4321-ba80-6afbad95f25b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2550305-9061-4d71-a68a-760282e90d1a]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] SCSI volumes sdd have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO859c16ca-8f2d14e0af6bcd60', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_859c16ca', '/dev/disk/by-id/scsi-23866326431346530') {{(pid=84257) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 18:06:42 user nova-compute[73007]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO859c16ca-8f2d14e0af6bcd60
Aug 15 18:06:42 user nova-compute[73007]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_859c16ca
Aug 15 18:06:42 user nova-compute[73007]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23866326431346530
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a25a51b-4692-4ca2-ba95-b49ea360d146]: (4, None) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0fb878-cb9f-4c1a-bea1-4411e60534ae]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:42 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e803500-405e-421a-bcc3-732e07ff0efe]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b, portal: 172.16.0.220,3260]
Aug 15 18:06:43 user nova-compute[73007]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b, portal: 172.16.0.220,3260] successful.
Aug 15 18:06:43 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce6b5aa-d6f5-4618-915c-3a87ba972f5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a208ad9-6cf3-4e75-a055-adfc61a1f5cb]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] <== disconnect_volume: return (309ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:06:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Deleting instance files /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583_del
Aug 15 18:06:43 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Deletion of /opt/stack/data/nova/instances/5d29f229-4024-4a0e-b18a-b7a79de8c583_del complete
Aug 15 18:06:43 user nova-compute[73007]: INFO nova.compute.manager [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 18:06:43 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:43 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Took 0.50 seconds to deallocate network for instance.
Aug 15 18:06:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f9f2672-5c20-4558-938b-7408264b88ed req-4fe91729-9d08-4872-8a9d-dcd25ca73476 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-deleted-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:43 user nova-compute[73007]: INFO nova.compute.manager [req-1f9f2672-5c20-4558-938b-7408264b88ed req-4fe91729-9d08-4872-8a9d-dcd25ca73476 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Neutron deleted interface 1f852c51-0895-4cf3-8fd9-a5b266f8166b; detaching it from the instance and deleting it from the info cache
Aug 15 18:06:43 user nova-compute[73007]: DEBUG nova.network.neutron [req-1f9f2672-5c20-4558-938b-7408264b88ed req-4fe91729-9d08-4872-8a9d-dcd25ca73476 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:06:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f9f2672-5c20-4558-938b-7408264b88ed req-4fe91729-9d08-4872-8a9d-dcd25ca73476 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Detach interface failed, port_id=1f852c51-0895-4cf3-8fd9-a5b266f8166b, reason: Instance 5d29f229-4024-4a0e-b18a-b7a79de8c583 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:06:44 user nova-compute[73007]: INFO nova.compute.manager [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Took 0.75 seconds to detach 1 volumes for instance.
Aug 15 18:06:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-ccbc30db-a49d-44eb-9a26-3c1d157f755c req-b26fdfba-8b8f-4bad-9b7e-144552aac3f7 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:06:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ccbc30db-a49d-44eb-9a26-3c1d157f755c req-b26fdfba-8b8f-4bad-9b7e-144552aac3f7 service nova] Acquiring lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:06:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ccbc30db-a49d-44eb-9a26-3c1d157f755c req-b26fdfba-8b8f-4bad-9b7e-144552aac3f7 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:06:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ccbc30db-a49d-44eb-9a26-3c1d157f755c req-b26fdfba-8b8f-4bad-9b7e-144552aac3f7 service nova] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:44 user nova-compute[73007]: DEBUG nova.compute.manager [req-ccbc30db-a49d-44eb-9a26-3c1d157f755c req-b26fdfba-8b8f-4bad-9b7e-144552aac3f7 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] No waiting events found dispatching network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:06:44 user nova-compute[73007]: WARNING nova.compute.manager [req-ccbc30db-a49d-44eb-9a26-3c1d157f755c req-b26fdfba-8b8f-4bad-9b7e-144552aac3f7 service nova] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Received unexpected event network-vif-plugged-1f852c51-0895-4cf3-8fd9-a5b266f8166b for instance with vm_state deleted and task_state None.
Aug 15 18:06:44 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:06:44 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:06:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:44 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Deleted allocations for instance 5d29f229-4024-4a0e-b18a-b7a79de8c583
Aug 15 18:06:44 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7df7c64f-0aca-42a1-b6bd-b4301a42c25e tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "5d29f229-4024-4a0e-b18a-b7a79de8c583" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.989s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:06:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:06:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:06:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:06:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:06:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:06:57 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122802.695973, 5d29f229-4024-4a0e-b18a-b7a79de8c583 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:06:57 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] VM Stopped (Lifecycle Event)
Aug 15 18:06:57 user nova-compute[73007]: DEBUG nova.compute.manager [None req-5b9ff874-d4d8-4bb4-b55b-25e076d18fc0 None None] [instance: 5d29f229-4024-4a0e-b18a-b7a79de8c583] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:06:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:07:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:07:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:07:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-aad8d4ed-8bfc-4771-89bc-39f337fa1a91 req-22094afa-2191-4a79-a360-124be2f2c101 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-changed-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-aad8d4ed-8bfc-4771-89bc-39f337fa1a91 req-22094afa-2191-4a79-a360-124be2f2c101 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Refreshing instance network info cache due to event network-changed-09b2d2bf-f241-4f89-ad13-1df13d27f1fc. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-aad8d4ed-8bfc-4771-89bc-39f337fa1a91 req-22094afa-2191-4a79-a360-124be2f2c101 service nova] Acquiring lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-aad8d4ed-8bfc-4771-89bc-39f337fa1a91 req-22094afa-2191-4a79-a360-124be2f2c101 service nova] Acquired lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-aad8d4ed-8bfc-4771-89bc-39f337fa1a91 req-22094afa-2191-4a79-a360-124be2f2c101 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Refreshing network info cache for port 09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-aad8d4ed-8bfc-4771-89bc-39f337fa1a91 req-22094afa-2191-4a79-a360-124be2f2c101 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updated VIF entry in instance network info cache for port 09b2d2bf-f241-4f89-ad13-1df13d27f1fc. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-aad8d4ed-8bfc-4771-89bc-39f337fa1a91 req-22094afa-2191-4a79-a360-124be2f2c101 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updating instance_info_cache with network_info: [{"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-aad8d4ed-8bfc-4771-89bc-39f337fa1a91 req-22094afa-2191-4a79-a360-124be2f2c101 service nova] Releasing lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-b017cb7a-4313-4207-a11c-718e592752e5 req-dec3b8ab-f33e-496e-b904-c6e5b9683c03 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-changed-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-b017cb7a-4313-4207-a11c-718e592752e5 req-dec3b8ab-f33e-496e-b904-c6e5b9683c03 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Refreshing instance network info cache due to event network-changed-09b2d2bf-f241-4f89-ad13-1df13d27f1fc. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b017cb7a-4313-4207-a11c-718e592752e5 req-dec3b8ab-f33e-496e-b904-c6e5b9683c03 service nova] Acquiring lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b017cb7a-4313-4207-a11c-718e592752e5 req-dec3b8ab-f33e-496e-b904-c6e5b9683c03 service nova] Acquired lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:07:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-b017cb7a-4313-4207-a11c-718e592752e5 req-dec3b8ab-f33e-496e-b904-c6e5b9683c03 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Refreshing network info cache for port 09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "ce363491-dc11-4d56-ad55-c675bfdae1b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:08 user nova-compute[73007]: INFO nova.compute.manager [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Terminating instance
Aug 15 18:07:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-b017cb7a-4313-4207-a11c-718e592752e5 req-dec3b8ab-f33e-496e-b904-c6e5b9683c03 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updated VIF entry in instance network info cache for port 09b2d2bf-f241-4f89-ad13-1df13d27f1fc. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-b017cb7a-4313-4207-a11c-718e592752e5 req-dec3b8ab-f33e-496e-b904-c6e5b9683c03 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updating instance_info_cache with network_info: [{"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b017cb7a-4313-4207-a11c-718e592752e5 req-dec3b8ab-f33e-496e-b904-c6e5b9683c03 service nova] Releasing lock "refresh_cache-ce363491-dc11-4d56-ad55-c675bfdae1b8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:07:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Instance destroyed successfully.
Aug 15 18:07:08 user nova-compute[73007]: DEBUG nova.objects.instance [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'resources' on Instance uuid ce363491-dc11-4d56-ad55-c675bfdae1b8 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:05:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1998509742',display_name='tempest-TestVolumeBootPattern-server-1998509742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1998509742',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:05:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-01o0x91q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:05:32Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=ce363491-dc11-4d56-ad55-c675bfdae1b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "address": "fa:16:3e:bc:f5:5c", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b2d2bf-f2", "ovs_interfaceid": "09b2d2bf-f241-4f89-ad13-1df13d27f1fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f5:5c,bridge_name='br-int',has_traffic_filtering=True,id=09b2d2bf-f241-4f89-ad13-1df13d27f1fc,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b2d2bf-f2') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_vif [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f5:5c,bridge_name='br-int',has_traffic_filtering=True,id=09b2d2bf-f241-4f89-ad13-1df13d27f1fc,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b2d2bf-f2') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09b2d2bf-f2, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:08 user nova-compute[73007]: INFO os_vif [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f5:5c,bridge_name='br-int',has_traffic_filtering=True,id=09b2d2bf-f241-4f89-ad13-1df13d27f1fc,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b2d2bf-f2')
Aug 15 18:07:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ScgaLiJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:07:08 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b50c2-5daa-4eef-b1bf-783dd27b413e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae91aaba-5a49-474d-9438-7862c4ab9bf4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:07:08 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:07:08 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:07:08 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:07:08 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:07:08 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:07:08 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:07:08 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:07:08 user nova-compute[73007]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc (non-flash)
Aug 15 18:07:08 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:07:08 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115079edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc'): ({'sdh'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Removing single pathed devices sdh {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bd8d8f-15f6-4ae5-9826-c72fd3930394]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f38818-af28-4f56-87bc-d6cc1301c759]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flushing IO for device /dev/sdh {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9872d6-bacb-40f9-87f0-88dda3000a6c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8322e01-0400-4fd0-9684-15028bfee1c0]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] SCSI volumes sdh have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab07390b-d540-43d3-aca3-775ee3dffd22]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-vif-unplugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] Acquiring lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] No waiting events found dispatching network-vif-unplugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-vif-unplugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] Acquiring lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] No waiting events found dispatching network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:09 user nova-compute[73007]: WARNING nova.compute.manager [req-f3b480e9-f571-4578-aa19-046dbcfb8d6e req-aa25ac7f-3f03-48fe-8cc0-90b821054ec5 service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received unexpected event network-vif-plugged-09b2d2bf-f241-4f89-ad13-1df13d27f1fc for instance with vm_state active and task_state deleting.
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db9ea0b-5578-42e8-8a6e-f469b94b8811]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc, portal: 172.16.0.220,3260]
Aug 15 18:07:09 user nova-compute[73007]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc, portal: 172.16.0.220,3260] successful.
Aug 15 18:07:09 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bd3bfbd-3a85-4b3c-815a-74040b1143fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ad3d31-e224-414c-b1bd-682f68f7221f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== disconnect_volume: return (301ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:07:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Deleting instance files /opt/stack/data/nova/instances/ce363491-dc11-4d56-ad55-c675bfdae1b8_del
Aug 15 18:07:09 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Deletion of /opt/stack/data/nova/instances/ce363491-dc11-4d56-ad55-c675bfdae1b8_del complete
Aug 15 18:07:09 user nova-compute[73007]: INFO nova.compute.manager [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:09 user nova-compute[73007]: INFO nova.compute.manager [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Terminating instance
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-dc33612b-6177-438b-8d17-0fb88e39ade0 req-0162cc5f-b953-4aec-89e2-0e980f6507ac service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dc33612b-6177-438b-8d17-0fb88e39ade0 req-0162cc5f-b953-4aec-89e2-0e980f6507ac service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dc33612b-6177-438b-8d17-0fb88e39ade0 req-0162cc5f-b953-4aec-89e2-0e980f6507ac service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-dc33612b-6177-438b-8d17-0fb88e39ade0 req-0162cc5f-b953-4aec-89e2-0e980f6507ac service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-dc33612b-6177-438b-8d17-0fb88e39ade0 req-0162cc5f-b953-4aec-89e2-0e980f6507ac service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-dc33612b-6177-438b-8d17-0fb88e39ade0 req-0162cc5f-b953-4aec-89e2-0e980f6507ac service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-unplugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:10 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Instance destroyed successfully.
Aug 15 18:07:10 user nova-compute[73007]: DEBUG nova.objects.instance [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'resources' on Instance uuid da287ce9-0600-43be-94aa-038eb1edaf07 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1475833445',display_name='tempest-ServerRescueNegativeTestJSON-server-1475833445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1475833445',id=39,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6C1KYKxf38rOwazJQZLOHCxAe4Mz4s81UJd04jHbux9L0G8Yk3C/k3ldVklTUJR5Ibv+Iv0VuGhVgS70ITXzaektW1NMxhLGHAsQg3vXL66frE4sFgjnqpkdxXMSS8XQ==',key_name='tempest-keypair-1271983282',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:02:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-m5enh7lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=da287ce9-0600-43be-94aa-038eb1edaf07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "f98c5145-23fc-4228-bf00-2a399bb280f0", "address": "fa:16:3e:9e:3c:6d", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98c5145-23", "ovs_interfaceid": "f98c5145-23fc-4228-bf00-2a399bb280f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=f98c5145-23fc-4228-bf00-2a399bb280f0,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98c5145-23') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG os_vif [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=f98c5145-23fc-4228-bf00-2a399bb280f0,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98c5145-23') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf98c5145-23, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:10 user nova-compute[73007]: INFO os_vif [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3c:6d,bridge_name='br-int',has_traffic_filtering=True,id=f98c5145-23fc-4228-bf00-2a399bb280f0,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98c5145-23')
Aug 15 18:07:10 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Deleting instance files /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07_del
Aug 15 18:07:10 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Deletion of /opt/stack/data/nova/instances/da287ce9-0600-43be-94aa-038eb1edaf07_del complete
Aug 15 18:07:10 user nova-compute[73007]: INFO nova.compute.manager [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 15 18:07:10 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:07:10 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:10 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Took 1.37 seconds to deallocate network for instance.
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-165f1193-244a-4220-bff5-f3a6e3afce89 req-0ca10968-91a8-4a59-8e43-c3fd3f4eb46b service nova] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Received event network-vif-deleted-09b2d2bf-f241-4f89-ad13-1df13d27f1fc {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:11 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Took 0.98 seconds to deallocate network for instance.
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-ec2c788d-e85c-4962-905e-d8370e0ebe9d req-4e6c5a17-c732-4978-bcb9-6a0c21ef616a service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-deleted-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:11 user nova-compute[73007]: INFO nova.compute.manager [req-ec2c788d-e85c-4962-905e-d8370e0ebe9d req-4e6c5a17-c732-4978-bcb9-6a0c21ef616a service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Neutron deleted interface f98c5145-23fc-4228-bf00-2a399bb280f0; detaching it from the instance and deleting it from the info cache
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-ec2c788d-e85c-4962-905e-d8370e0ebe9d req-4e6c5a17-c732-4978-bcb9-6a0c21ef616a service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:11 user nova-compute[73007]: INFO nova.compute.manager [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Took 0.79 seconds to detach 1 volumes for instance.
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-ec2c788d-e85c-4962-905e-d8370e0ebe9d req-4e6c5a17-c732-4978-bcb9-6a0c21ef616a service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Detach interface failed, port_id=f98c5145-23fc-4228-bf00-2a399bb280f0, reason: Instance da287ce9-0600-43be-94aa-038eb1edaf07 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.369s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:11 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Deleted allocations for instance da287ce9-0600-43be-94aa-038eb1edaf07
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-71b0ef91-a9d5-41b0-b422-a6ab9ed1de75 req-5bac117b-9757-41c8-8c6c-85139ff0fba7 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-71b0ef91-a9d5-41b0-b422-a6ab9ed1de75 req-5bac117b-9757-41c8-8c6c-85139ff0fba7 service nova] Acquiring lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-71b0ef91-a9d5-41b0-b422-a6ab9ed1de75 req-5bac117b-9757-41c8-8c6c-85139ff0fba7 service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-71b0ef91-a9d5-41b0-b422-a6ab9ed1de75 req-5bac117b-9757-41c8-8c6c-85139ff0fba7 service nova] Lock "da287ce9-0600-43be-94aa-038eb1edaf07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-71b0ef91-a9d5-41b0-b422-a6ab9ed1de75 req-5bac117b-9757-41c8-8c6c-85139ff0fba7 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] No waiting events found dispatching network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:11 user nova-compute[73007]: WARNING nova.compute.manager [req-71b0ef91-a9d5-41b0-b422-a6ab9ed1de75 req-5bac117b-9757-41c8-8c6c-85139ff0fba7 service nova] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Received unexpected event network-vif-plugged-f98c5145-23fc-4228-bf00-2a399bb280f0 for instance with vm_state deleted and task_state None.
Aug 15 18:07:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-27e3c158-3dcf-429c-9570-ddc78515f15e tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "da287ce9-0600-43be-94aa-038eb1edaf07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.580s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:12 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:07:12 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:07:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:12 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Deleted allocations for instance ce363491-dc11-4d56-ad55-c675bfdae1b8
Aug 15 18:07:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-65f10f81-c756-4d53-b55d-538b3b1d8965 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "ce363491-dc11-4d56-ad55-c675bfdae1b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.270s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:13 user nova-compute[73007]: INFO nova.compute.manager [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Terminating instance
Aug 15 18:07:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-2aa5234b-025f-4d93-aab4-3bf79cc75cd3 req-dc0c17bf-56c1-4422-b17c-deca20b1073e service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-unplugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2aa5234b-025f-4d93-aab4-3bf79cc75cd3 req-dc0c17bf-56c1-4422-b17c-deca20b1073e service nova] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2aa5234b-025f-4d93-aab4-3bf79cc75cd3 req-dc0c17bf-56c1-4422-b17c-deca20b1073e service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2aa5234b-025f-4d93-aab4-3bf79cc75cd3 req-dc0c17bf-56c1-4422-b17c-deca20b1073e service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-2aa5234b-025f-4d93-aab4-3bf79cc75cd3 req-dc0c17bf-56c1-4422-b17c-deca20b1073e service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] No waiting events found dispatching network-vif-unplugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-2aa5234b-025f-4d93-aab4-3bf79cc75cd3 req-dc0c17bf-56c1-4422-b17c-deca20b1073e service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-unplugged-6120a809-279a-4cb4-b7d7-17da5e39273f for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:07:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Instance destroyed successfully.
Aug 15 18:07:13 user nova-compute[73007]: DEBUG nova.objects.instance [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'resources' on Instance uuid 6545b6a7-4c0e-4d97-8c98-7491292c566a {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1652858877',display_name='tempest-TestMinimumBasicScenario-server-1652858877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1652858877',id=41,image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgeUvRRpeWnwuUO8i59hmKKurHKDuyNddeJ5d2vXN4gN93Z9y7tetWok1QrY1pdDvYXaPQGwx9njGawQmiov6dk+UAW7t4DM9brzrIwaaT480dRSg3LiePVo60gQc/yNg==',key_name='tempest-TestMinimumBasicScenario-1607872540',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-tw49lt7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='53b95b3d-55cc-4553-a1d3-d3cce54355b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:04:32Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=6545b6a7-4c0e-4d97-8c98-7491292c566a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "6120a809-279a-4cb4-b7d7-17da5e39273f", "address": "fa:16:3e:f0:3a:c8", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6120a809-27", "ovs_interfaceid": "6120a809-279a-4cb4-b7d7-17da5e39273f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG os_vif [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6120a809-27, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:13 user nova-compute[73007]: INFO os_vif [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3a:c8,bridge_name='br-int',has_traffic_filtering=True,id=6120a809-279a-4cb4-b7d7-17da5e39273f,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6120a809-27')
Aug 15 18:07:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Deleting instance files /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a_del
Aug 15 18:07:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Deletion of /opt/stack/data/nova/instances/6545b6a7-4c0e-4d97-8c98-7491292c566a_del complete
Aug 15 18:07:14 user nova-compute[73007]: INFO nova.compute.manager [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 18:07:14 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:07:14 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:07:14 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:07:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:14 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:14 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Took 0.49 seconds to deallocate network for instance.
Aug 15 18:07:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:14 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:07:14 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:07:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:15 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Deleted allocations for instance 6545b6a7-4c0e-4d97-8c98-7491292c566a
Aug 15 18:07:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-7db7698e-eac6-4c39-95bf-a962da2783fa tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.967s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-92c37d4b-3567-4c85-a4cb-e426167227fb req-38c65468-e70e-491f-9747-316805bc684c service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-92c37d4b-3567-4c85-a4cb-e426167227fb req-38c65468-e70e-491f-9747-316805bc684c service nova] Acquiring lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-92c37d4b-3567-4c85-a4cb-e426167227fb req-38c65468-e70e-491f-9747-316805bc684c service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-92c37d4b-3567-4c85-a4cb-e426167227fb req-38c65468-e70e-491f-9747-316805bc684c service nova] Lock "6545b6a7-4c0e-4d97-8c98-7491292c566a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-92c37d4b-3567-4c85-a4cb-e426167227fb req-38c65468-e70e-491f-9747-316805bc684c service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] No waiting events found dispatching network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:15 user nova-compute[73007]: WARNING nova.compute.manager [req-92c37d4b-3567-4c85-a4cb-e426167227fb req-38c65468-e70e-491f-9747-316805bc684c service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received unexpected event network-vif-plugged-6120a809-279a-4cb4-b7d7-17da5e39273f for instance with vm_state deleted and task_state None.
Aug 15 18:07:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-92c37d4b-3567-4c85-a4cb-e426167227fb req-38c65468-e70e-491f-9747-316805bc684c service nova] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Received event network-vif-deleted-6120a809-279a-4cb4-b7d7-17da5e39273f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updating instance_info_cache with network_info: [{"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:07:17 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:07:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=7561MB free_disk=24.7943115234375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d9648621-6b91-4028-9f89-83302bc7a8cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance bec479f1-341e-4879-8280-8f3bc9b9e5a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e80a756d-ec14-417e-8164-a1e9db7041d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 3cb91142-7140-45a7-8f42-d515c7ffb158 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:07:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-4c8ebc9e-64cb-4f9e-a50e-04865995ef20 req-042db595-949b-4751-8905-fd585ee5f60b service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-4c8ebc9e-64cb-4f9e-a50e-04865995ef20 req-042db595-949b-4751-8905-fd585ee5f60b service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing instance network info cache due to event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4c8ebc9e-64cb-4f9e-a50e-04865995ef20 req-042db595-949b-4751-8905-fd585ee5f60b service nova] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4c8ebc9e-64cb-4f9e-a50e-04865995ef20 req-042db595-949b-4751-8905-fd585ee5f60b service nova] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.network.neutron [req-4c8ebc9e-64cb-4f9e-a50e-04865995ef20 req-042db595-949b-4751-8905-fd585ee5f60b service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.network.neutron [req-4c8ebc9e-64cb-4f9e-a50e-04865995ef20 req-042db595-949b-4751-8905-fd585ee5f60b service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updated VIF entry in instance network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.network.neutron [req-4c8ebc9e-64cb-4f9e-a50e-04865995ef20 req-042db595-949b-4751-8905-fd585ee5f60b service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:23 user nova-compute[73007]: INFO nova.compute.manager [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Shelve offloading
Aug 15 18:07:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4c8ebc9e-64cb-4f9e-a50e-04865995ef20 req-042db595-949b-4751-8905-fd585ee5f60b service nova] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122828.8194532, ce363491-dc11-4d56-ad55-c675bfdae1b8 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:07:23 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] VM Stopped (Lifecycle Event)
Aug 15 18:07:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-83cb2a2d-c7bf-40f3-80c7-cafe98159f06 None None] [instance: ce363491-dc11-4d56-ad55-c675bfdae1b8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-2abc36bc-9152-4ddb-b82a-2dbb97a4bca6 req-83a039af-712b-44bb-b1e9-3ad13410960b service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-unplugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2abc36bc-9152-4ddb-b82a-2dbb97a4bca6 req-83a039af-712b-44bb-b1e9-3ad13410960b service nova] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2abc36bc-9152-4ddb-b82a-2dbb97a4bca6 req-83a039af-712b-44bb-b1e9-3ad13410960b service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2abc36bc-9152-4ddb-b82a-2dbb97a4bca6 req-83a039af-712b-44bb-b1e9-3ad13410960b service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-2abc36bc-9152-4ddb-b82a-2dbb97a4bca6 req-83a039af-712b-44bb-b1e9-3ad13410960b service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] No waiting events found dispatching network-vif-unplugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:24 user nova-compute[73007]: WARNING nova.compute.manager [req-2abc36bc-9152-4ddb-b82a-2dbb97a4bca6 req-83a039af-712b-44bb-b1e9-3ad13410960b service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received unexpected event network-vif-unplugged-70d465d4-7680-4c97-bdd8-06f77e426e2f for instance with vm_state active and task_state shelving.
Aug 15 18:07:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance destroyed successfully.
Aug 15 18:07:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:07:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122830.2002566, da287ce9-0600-43be-94aa-038eb1edaf07 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:07:25 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] VM Stopped (Lifecycle Event)
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d076ecdb-f7b9-4928-97c2-9af4c28a5125 None None] [instance: da287ce9-0600-43be-94aa-038eb1edaf07] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:07:25 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance destroyed successfully.
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lazy-loading 'resources' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1555420845',display_name='tempest-TestShelveInstance-server-1555420845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1555420845',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Uy7J7kEGqI576s+LbH3MCZFhYymIIQh/NtmKCy09E5kh0EHjfLzTqoLSdwzJFvliG8DKTbZV+03bDKw2UhygRVGqzr+pdlg/XGYzPaUKs0lz1NfTKG51DZvT04CCY3A==',key_name='tempest-TestShelveInstance-249784429',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:05:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='005b9f27d3394fe78f7998562bc76e7f',ramdisk_id='',reservation_id='r-mf3ssg2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1310135125',owner_user_name='tempest-TestShelveInstance-1310135125-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:05:47Z,user_data=None,user_id='e603d59405784668a5e1e1fa8d5ea8d0',uuid=3cb91142-7140-45a7-8f42-d515c7ffb158,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converting VIF {"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_vif [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d465d4-76, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-8835f9e3-42ee-449f-ad9d-7691f1f43deb req-ec73b17b-4f4b-4bfa-9ab4-dedf2656963c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-8835f9e3-42ee-449f-ad9d-7691f1f43deb req-ec73b17b-4f4b-4bfa-9ab4-dedf2656963c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing instance network info cache due to event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8835f9e3-42ee-449f-ad9d-7691f1f43deb req-ec73b17b-4f4b-4bfa-9ab4-dedf2656963c service nova] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8835f9e3-42ee-449f-ad9d-7691f1f43deb req-ec73b17b-4f4b-4bfa-9ab4-dedf2656963c service nova] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.network.neutron [req-8835f9e3-42ee-449f-ad9d-7691f1f43deb req-ec73b17b-4f4b-4bfa-9ab4-dedf2656963c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:25 user nova-compute[73007]: INFO os_vif [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76')
Aug 15 18:07:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFRPpDqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:07:25 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd39af96-6c8d-4183-a990-9fa9dd8c4fc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[540ad053-6d30-484e-b809-f9ec1b4372cd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:07:25 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:07:25 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:07:25 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:07:25 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:07:25 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:07:25 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:07:25 user nova-compute[73007]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:07:25 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7e3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce'): ({'sdi'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Removing single pathed devices sdi {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd761ba7-7aba-48ac-9474-f6996567b73f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1ab9d4-807b-472d-bb4f-be319360ec9e]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Flushing IO for device /dev/sdi {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[73de75f3-35a4-4319-826e-5697905e5d9e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c1a73-e598-4a4d-a559-fcbef11f4b59]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] SCSI volumes sdi have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[885a7cf8-6fb4-4cdb-b7b6-6a6c301bb345]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:07:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cbd1e3-4b7e-4887-8062-a8aa07434851]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260]
Aug 15 18:07:26 user nova-compute[73007]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260] successful.
Aug 15 18:07:26 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[837ba49d-8721-499d-a2cb-27c8d52a933b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] <== disconnect_volume: return (307ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:07:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Deleting instance files /opt/stack/data/nova/instances/3cb91142-7140-45a7-8f42-d515c7ffb158_del
Aug 15 18:07:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Deletion of /opt/stack/data/nova/instances/3cb91142-7140-45a7-8f42-d515c7ffb158_del complete
Aug 15 18:07:26 user nova-compute[73007]: DEBUG nova.network.neutron [req-8835f9e3-42ee-449f-ad9d-7691f1f43deb req-ec73b17b-4f4b-4bfa-9ab4-dedf2656963c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updated VIF entry in instance network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG nova.network.neutron [req-8835f9e3-42ee-449f-ad9d-7691f1f43deb req-ec73b17b-4f4b-4bfa-9ab4-dedf2656963c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": null, "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap70d465d4-76", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-ad63f74f-bacd-4b4a-a0eb-9e487e3b1c4e req-6b5498f4-579f-458c-974a-3056689847f5 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ad63f74f-bacd-4b4a-a0eb-9e487e3b1c4e req-6b5498f4-579f-458c-974a-3056689847f5 service nova] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ad63f74f-bacd-4b4a-a0eb-9e487e3b1c4e req-6b5498f4-579f-458c-974a-3056689847f5 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ad63f74f-bacd-4b4a-a0eb-9e487e3b1c4e req-6b5498f4-579f-458c-974a-3056689847f5 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-ad63f74f-bacd-4b4a-a0eb-9e487e3b1c4e req-6b5498f4-579f-458c-974a-3056689847f5 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] No waiting events found dispatching network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:26 user nova-compute[73007]: WARNING nova.compute.manager [req-ad63f74f-bacd-4b4a-a0eb-9e487e3b1c4e req-6b5498f4-579f-458c-974a-3056689847f5 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received unexpected event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f for instance with vm_state active and task_state shelving.
Aug 15 18:07:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8835f9e3-42ee-449f-ad9d-7691f1f43deb req-ec73b17b-4f4b-4bfa-9ab4-dedf2656963c service nova] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:07:27 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Deleted allocations for instance 3cb91142-7140-45a7-8f42-d515c7ffb158
Aug 15 18:07:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:07:27 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:07:27 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:07:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a8acb62f-bf1f-4474-81d3-c4b5d86203b1 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.706s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-41424a94-6a84-40d5-a663-a90dc41c7267 req-4ad396f1-8fbb-4178-b9d2-c9cf72dcc8e0 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-changed-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-41424a94-6a84-40d5-a663-a90dc41c7267 req-4ad396f1-8fbb-4178-b9d2-c9cf72dcc8e0 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Refreshing instance network info cache due to event network-changed-cc02a4b7-09c0-4dee-9f52-7546e80dad26. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-41424a94-6a84-40d5-a663-a90dc41c7267 req-4ad396f1-8fbb-4178-b9d2-c9cf72dcc8e0 service nova] Acquiring lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-41424a94-6a84-40d5-a663-a90dc41c7267 req-4ad396f1-8fbb-4178-b9d2-c9cf72dcc8e0 service nova] Acquired lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.network.neutron [req-41424a94-6a84-40d5-a663-a90dc41c7267 req-4ad396f1-8fbb-4178-b9d2-c9cf72dcc8e0 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Refreshing network info cache for port cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:28 user nova-compute[73007]: INFO nova.compute.manager [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Terminating instance
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-f8840e47-2c76-47f5-8f6c-3ca07daf8865 req-083d98a1-2b5a-441a-afda-4fc7c0c60fad service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-vif-unplugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f8840e47-2c76-47f5-8f6c-3ca07daf8865 req-083d98a1-2b5a-441a-afda-4fc7c0c60fad service nova] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f8840e47-2c76-47f5-8f6c-3ca07daf8865 req-083d98a1-2b5a-441a-afda-4fc7c0c60fad service nova] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f8840e47-2c76-47f5-8f6c-3ca07daf8865 req-083d98a1-2b5a-441a-afda-4fc7c0c60fad service nova] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-f8840e47-2c76-47f5-8f6c-3ca07daf8865 req-083d98a1-2b5a-441a-afda-4fc7c0c60fad service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] No waiting events found dispatching network-vif-unplugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.compute.manager [req-f8840e47-2c76-47f5-8f6c-3ca07daf8865 req-083d98a1-2b5a-441a-afda-4fc7c0c60fad service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-vif-unplugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122833.9573805, 6545b6a7-4c0e-4d97-8c98-7491292c566a => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:07:28 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] VM Stopped (Lifecycle Event)
Aug 15 18:07:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-07df7a16-5762-4bc5-b7d1-09aa30ad6ef0 None None] [instance: 6545b6a7-4c0e-4d97-8c98-7491292c566a] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-41424a94-6a84-40d5-a663-a90dc41c7267 req-4ad396f1-8fbb-4178-b9d2-c9cf72dcc8e0 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updated VIF entry in instance network info cache for port cc02a4b7-09c0-4dee-9f52-7546e80dad26. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-41424a94-6a84-40d5-a663-a90dc41c7267 req-4ad396f1-8fbb-4178-b9d2-c9cf72dcc8e0 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updating instance_info_cache with network_info: [{"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-41424a94-6a84-40d5-a663-a90dc41c7267 req-4ad396f1-8fbb-4178-b9d2-c9cf72dcc8e0 service nova] Releasing lock "refresh_cache-5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:07:29 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Instance destroyed successfully.
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.objects.instance [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lazy-loading 'resources' on Instance uuid 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1317595518',display_name='tempest-TestStampPattern-server-1317595518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1317595518',id=37,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2Wzpkb4d/FqkLpOgMs40DkQZ4S3W/bdhb1IceHH+6YDRcBBgEJz/OwRQD9/KRHQQ/5ClKqrnorBoWo+ErrhtxAJD56iE9sp7wIWJnjhB08h2DT6wHTAeyjVek0+ZKfdQ==',key_name='tempest-TestStampPattern-319626008',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:00:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9dc4bf210044c769da4afeb6fbb7607',ramdisk_id='',reservation_id='r-8z4crird',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1140446429',owner_user_name='tempest-TestStampPattern-1140446429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:03:25Z,user_data=None,user_id='0a4ecddd550e412e83798beb94d71db6',uuid=5ed0a68e-b82d-4aa9-b7d6-01aaa573c541,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converting VIF {"id": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "address": "fa:16:3e:1d:ca:a3", "network": {"id": "7a3be313-5e17-4017-a656-9d9c3b1b4a11", "bridge": "br-int", "label": "tempest-TestStampPattern-1622651079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9dc4bf210044c769da4afeb6fbb7607", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02a4b7-09", "ovs_interfaceid": "cc02a4b7-09c0-4dee-9f52-7546e80dad26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ca:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc02a4b7-09c0-4dee-9f52-7546e80dad26,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02a4b7-09') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG os_vif [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ca:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc02a4b7-09c0-4dee-9f52-7546e80dad26,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02a4b7-09') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc02a4b7-09, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:29 user nova-compute[73007]: INFO os_vif [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ca:a3,bridge_name='br-int',has_traffic_filtering=True,id=cc02a4b7-09c0-4dee-9f52-7546e80dad26,network=Network(7a3be313-5e17-4017-a656-9d9c3b1b4a11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02a4b7-09')
Aug 15 18:07:29 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Deleting instance files /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541_del
Aug 15 18:07:29 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Deletion of /opt/stack/data/nova/instances/5ed0a68e-b82d-4aa9-b7d6-01aaa573c541_del complete
Aug 15 18:07:29 user nova-compute[73007]: INFO nova.compute.manager [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 18:07:29 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:29 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Took 0.39 seconds to deallocate network for instance.
Aug 15 18:07:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:30 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Deleted allocations for instance 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541
Aug 15 18:07:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-689befcc-a5ab-434d-be8a-998bb0832511 tempest-TestStampPattern-1140446429 tempest-TestStampPattern-1140446429-project-member] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.701s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-48077711-32d9-4d4c-9d5f-c85c059665c9 req-61215a21-3ee6-4df1-ab7c-e55037aeb922 service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-vif-deleted-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-bde4b187-4c69-4a09-9d33-c6bdb5a55359 req-c2ed0d82-5cb0-477e-aace-66b1cd06974b service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received event network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bde4b187-4c69-4a09-9d33-c6bdb5a55359 req-c2ed0d82-5cb0-477e-aace-66b1cd06974b service nova] Acquiring lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bde4b187-4c69-4a09-9d33-c6bdb5a55359 req-c2ed0d82-5cb0-477e-aace-66b1cd06974b service nova] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-bde4b187-4c69-4a09-9d33-c6bdb5a55359 req-c2ed0d82-5cb0-477e-aace-66b1cd06974b service nova] Lock "5ed0a68e-b82d-4aa9-b7d6-01aaa573c541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:30 user nova-compute[73007]: DEBUG nova.compute.manager [req-bde4b187-4c69-4a09-9d33-c6bdb5a55359 req-c2ed0d82-5cb0-477e-aace-66b1cd06974b service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] No waiting events found dispatching network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:30 user nova-compute[73007]: WARNING nova.compute.manager [req-bde4b187-4c69-4a09-9d33-c6bdb5a55359 req-c2ed0d82-5cb0-477e-aace-66b1cd06974b service nova] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Received unexpected event network-vif-plugged-cc02a4b7-09c0-4dee-9f52-7546e80dad26 for instance with vm_state deleted and task_state None.
Aug 15 18:07:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:32 user nova-compute[73007]: INFO nova.compute.manager [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Terminating instance
Aug 15 18:07:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:07:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-b6d8b26d-e652-42da-8a14-57a4ab057a0c req-925c6199-1225-4ca7-90c0-f4004b53ca45 service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received event network-vif-unplugged-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b6d8b26d-e652-42da-8a14-57a4ab057a0c req-925c6199-1225-4ca7-90c0-f4004b53ca45 service nova] Acquiring lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b6d8b26d-e652-42da-8a14-57a4ab057a0c req-925c6199-1225-4ca7-90c0-f4004b53ca45 service nova] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b6d8b26d-e652-42da-8a14-57a4ab057a0c req-925c6199-1225-4ca7-90c0-f4004b53ca45 service nova] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-b6d8b26d-e652-42da-8a14-57a4ab057a0c req-925c6199-1225-4ca7-90c0-f4004b53ca45 service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] No waiting events found dispatching network-vif-unplugged-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.compute.manager [req-b6d8b26d-e652-42da-8a14-57a4ab057a0c req-925c6199-1225-4ca7-90c0-f4004b53ca45 service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received event network-vif-unplugged-55b461e7-4199-4856-a1b0-d2bb302db323 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Instance destroyed successfully.
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'resources' on Instance uuid bec479f1-341e-4879-8280-8f3bc9b9e5a0 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2023879861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2023879861',id=36,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-4kr7qazz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:00:06Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=bec479f1-341e-4879-8280-8f3bc9b9e5a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "55b461e7-4199-4856-a1b0-d2bb302db323", "address": "fa:16:3e:73:11:7e", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b461e7-41", "ovs_interfaceid": "55b461e7-4199-4856-a1b0-d2bb302db323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=55b461e7-4199-4856-a1b0-d2bb302db323,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b461e7-41') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG os_vif [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=55b461e7-4199-4856-a1b0-d2bb302db323,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b461e7-41') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55b461e7-41, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:33 user nova-compute[73007]: INFO os_vif [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:11:7e,bridge_name='br-int',has_traffic_filtering=True,id=55b461e7-4199-4856-a1b0-d2bb302db323,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b461e7-41')
Aug 15 18:07:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Deleting instance files /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0_del
Aug 15 18:07:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Deletion of /opt/stack/data/nova/instances/bec479f1-341e-4879-8280-8f3bc9b9e5a0_del complete
Aug 15 18:07:33 user nova-compute[73007]: INFO nova.compute.manager [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 15 18:07:33 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:07:33 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:07:34 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:07:34 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Took 0.50 seconds to deallocate network for instance.
Aug 15 18:07:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-35e18978-bda6-462f-a147-c65cea0fda09 req-c7851497-b170-4f61-9843-aa2d414c7960 service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received event network-vif-deleted-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:34 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:07:34 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:07:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:34 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Deleted allocations for instance bec479f1-341e-4879-8280-8f3bc9b9e5a0
Aug 15 18:07:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-6a489784-08e6-4418-b427-a7930b7b245a tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.629s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-145847b6-ddd1-4fdb-9e23-5c40dae8fd99 req-7433e7e1-e077-4cce-bccc-08920289d9ba service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received event network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:07:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-145847b6-ddd1-4fdb-9e23-5c40dae8fd99 req-7433e7e1-e077-4cce-bccc-08920289d9ba service nova] Acquiring lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:07:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-145847b6-ddd1-4fdb-9e23-5c40dae8fd99 req-7433e7e1-e077-4cce-bccc-08920289d9ba service nova] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:07:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-145847b6-ddd1-4fdb-9e23-5c40dae8fd99 req-7433e7e1-e077-4cce-bccc-08920289d9ba service nova] Lock "bec479f1-341e-4879-8280-8f3bc9b9e5a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:07:35 user nova-compute[73007]: DEBUG nova.compute.manager [req-145847b6-ddd1-4fdb-9e23-5c40dae8fd99 req-7433e7e1-e077-4cce-bccc-08920289d9ba service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] No waiting events found dispatching network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:07:35 user nova-compute[73007]: WARNING nova.compute.manager [req-145847b6-ddd1-4fdb-9e23-5c40dae8fd99 req-7433e7e1-e077-4cce-bccc-08920289d9ba service nova] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Received unexpected event network-vif-plugged-55b461e7-4199-4856-a1b0-d2bb302db323 for instance with vm_state deleted and task_state None.
Aug 15 18:07:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:39 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122844.5403678, 3cb91142-7140-45a7-8f42-d515c7ffb158 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:07:39 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] VM Stopped (Lifecycle Event)
Aug 15 18:07:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-fbfce507-1eeb-457d-bfe5-1fe8029500d4 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:07:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:44 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122849.4064274, 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:07:44 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] VM Stopped (Lifecycle Event)
Aug 15 18:07:44 user nova-compute[73007]: DEBUG nova.compute.manager [None req-5560007e-1100-45f7-bc18-0196d72982b8 None None] [instance: 5ed0a68e-b82d-4aa9-b7d6-01aaa573c541] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:07:48 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122853.4826968, bec479f1-341e-4879-8280-8f3bc9b9e5a0 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:07:48 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] VM Stopped (Lifecycle Event)
Aug 15 18:07:48 user nova-compute[73007]: DEBUG nova.compute.manager [None req-01aef126-1105-405b-99d4-0d1d63e8bb72 None None] [instance: bec479f1-341e-4879-8280-8f3bc9b9e5a0] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:07:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:07:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:07:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:08:07 user nova-compute[73007]: INFO nova.compute.claims [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Claim successful on node user
Aug 15 18:08:07 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:08:07 user nova-compute[73007]: DEBUG nova.network.neutron [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:08:07 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:08:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:08:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Creating image(s)
Aug 15 18:08:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "/opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "/opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "/opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "39de03cc8182c021a3abba01cde969d9291ba9b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "39de03cc8182c021a3abba01cde969d9291ba9b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9.part --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG nova.policy [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60ec8200260d42b7bdb788b3f745eb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06843dd305d24f79b1aa4f4772322248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9.part --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG nova.virt.images [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] e7ca193d-4e89-4a1e-baed-7492855baaa2 was qcow2, converting to raw {{(pid=73007) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG nova.privsep.utils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73007) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 18:08:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9.part /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9.converted {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9.part /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9.converted" returned: 0 in 0.352s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9.converted --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:09 user nova-compute[73007]: INFO nova.compute.manager [None req-304cb256-ad07-4351-a0ee-0297f2769e24 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Get console output
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "39de03cc8182c021a3abba01cde969d9291ba9b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.344s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:09 user nova-compute[73007]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 18:08:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG nova.network.neutron [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Successfully created port: dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9 --force-share --output=json" returned: 0 in 0.211s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "39de03cc8182c021a3abba01cde969d9291ba9b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "39de03cc8182c021a3abba01cde969d9291ba9b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9 --force-share --output=json" returned: 0 in 0.335s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:09 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9,backing_fmt=raw /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9,backing_fmt=raw /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk 1073741824" returned: 0 in 0.066s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "39de03cc8182c021a3abba01cde969d9291ba9b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.410s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9 --force-share --output=json" returned: 0 in 0.257s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Cannot resize image /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG nova.objects.instance [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'migration_context' on Instance uuid e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Ensure instance console log exists: /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Successfully updated port: dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:08:10 user nova-compute[73007]: DEBUG nova.network.neutron [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-1995fc8c-b014-46cc-a268-7cea8dced179 req-46acc84c-8ced-44f6-8299-52f11ef1fd10 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-1995fc8c-b014-46cc-a268-7cea8dced179 req-46acc84c-8ced-44f6-8299-52f11ef1fd10 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing instance network info cache due to event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1995fc8c-b014-46cc-a268-7cea8dced179 req-46acc84c-8ced-44f6-8299-52f11ef1fd10 service nova] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-a6a7abfd-55e3-4ead-806d-11281efc7b7f req-a4075043-7e38-4b78-bace-e2a5a292a60f service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-changed-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.compute.manager [req-a6a7abfd-55e3-4ead-806d-11281efc7b7f req-a4075043-7e38-4b78-bace-e2a5a292a60f service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Refreshing instance network info cache due to event network-changed-3e388fd1-eeef-4853-b992-91c420a3c694. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a6a7abfd-55e3-4ead-806d-11281efc7b7f req-a4075043-7e38-4b78-bace-e2a5a292a60f service nova] Acquiring lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a6a7abfd-55e3-4ead-806d-11281efc7b7f req-a4075043-7e38-4b78-bace-e2a5a292a60f service nova] Acquired lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-a6a7abfd-55e3-4ead-806d-11281efc7b7f req-a4075043-7e38-4b78-bace-e2a5a292a60f service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Refreshing network info cache for port 3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "e80a756d-ec14-417e-8164-a1e9db7041d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:11 user nova-compute[73007]: INFO nova.compute.manager [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Terminating instance
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.neutron [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Instance network_info: |[{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1995fc8c-b014-46cc-a268-7cea8dced179 req-46acc84c-8ced-44f6-8299-52f11ef1fd10 service nova] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-1995fc8c-b014-46cc-a268-7cea8dced179 req-46acc84c-8ced-44f6-8299-52f11ef1fd10 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Start _get_guest_xml network_info=[{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T18:08:04Z,direct_url=<?>,disk_format='qcow2',id=e7ca193d-4e89-4a1e-baed-7492855baaa2,min_disk=0,min_ram=0,name='tempest-scenario-img--263843008',owner='06843dd305d24f79b1aa4f4772322248',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T18:08:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'e7ca193d-4e89-4a1e-baed-7492855baaa2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:08:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:08:11 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T18:08:04Z,direct_url=<?>,disk_format='qcow2',id=e7ca193d-4e89-4a1e-baed-7492855baaa2,min_disk=0,min_ram=0,name='tempest-scenario-img--263843008',owner='06843dd305d24f79b1aa4f4772322248',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T18:08:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1856518961',display_name='tempest-TestMinimumBasicScenario-server-1856518961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1856518961',id=48,image_ref='e7ca193d-4e89-4a1e-baed-7492855baaa2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOEWMhtx7yF9uY2ud4U5FBIhgETHwpEr2Hha5RM8E05U9EVXwhNtNuFChtE1j0+7jD79uMcr8ntxiEn38O8leCON2dEddAKLl29IGZ8TeHBMPPXdo0B1Q5LJc1oeUJxPg==',key_name='tempest-TestMinimumBasicScenario-1615031928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-seg7za4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e7ca193d-4e89-4a1e-baed-7492855baaa2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:08:08Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=e315d959-2703-4141-9517-461b29fa492b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=dd923fa0-f782-46e9-a52f-5d8042c5a906,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd923fa0-f7') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'pci_devices' on Instance uuid e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:08:11 user nova-compute[73007]:   <uuid>e315d959-2703-4141-9517-461b29fa492b</uuid>
Aug 15 18:08:11 user nova-compute[73007]:   <name>instance-00000030</name>
Aug 15 18:08:11 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:08:11 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:08:11 user nova-compute[73007]:   <metadata>
Aug 15 18:08:11 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:08:11 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:08:11 user nova-compute[73007]:       <nova:name>tempest-TestMinimumBasicScenario-server-1856518961</nova:name>
Aug 15 18:08:11 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:08:11</nova:creationTime>
Aug 15 18:08:11 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:08:11 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:08:11 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:08:11 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:08:11 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:08:11 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:08:11 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:08:11 user nova-compute[73007]:       <nova:owner>
Aug 15 18:08:11 user nova-compute[73007]:         <nova:user uuid="60ec8200260d42b7bdb788b3f745eb84">tempest-TestMinimumBasicScenario-1021033428-project-member</nova:user>
Aug 15 18:08:11 user nova-compute[73007]:         <nova:project uuid="06843dd305d24f79b1aa4f4772322248">tempest-TestMinimumBasicScenario-1021033428</nova:project>
Aug 15 18:08:11 user nova-compute[73007]:       </nova:owner>
Aug 15 18:08:11 user nova-compute[73007]:       <nova:root type="image" uuid="e7ca193d-4e89-4a1e-baed-7492855baaa2"/>
Aug 15 18:08:11 user nova-compute[73007]:       <nova:ports>
Aug 15 18:08:11 user nova-compute[73007]:         <nova:port uuid="dd923fa0-f782-46e9-a52f-5d8042c5a906">
Aug 15 18:08:11 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 18:08:11 user nova-compute[73007]:         </nova:port>
Aug 15 18:08:11 user nova-compute[73007]:       </nova:ports>
Aug 15 18:08:11 user nova-compute[73007]:     </nova:instance>
Aug 15 18:08:11 user nova-compute[73007]:   </metadata>
Aug 15 18:08:11 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:08:11 user nova-compute[73007]:     <system>
Aug 15 18:08:11 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:08:11 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:08:11 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:08:11 user nova-compute[73007]:       <entry name="serial">e315d959-2703-4141-9517-461b29fa492b</entry>
Aug 15 18:08:11 user nova-compute[73007]:       <entry name="uuid">e315d959-2703-4141-9517-461b29fa492b</entry>
Aug 15 18:08:11 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:08:11 user nova-compute[73007]:     </system>
Aug 15 18:08:11 user nova-compute[73007]:   </sysinfo>
Aug 15 18:08:11 user nova-compute[73007]:   <os>
Aug 15 18:08:11 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:08:11 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:08:11 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:08:11 user nova-compute[73007]:   </os>
Aug 15 18:08:11 user nova-compute[73007]:   <features>
Aug 15 18:08:11 user nova-compute[73007]:     <acpi/>
Aug 15 18:08:11 user nova-compute[73007]:     <apic/>
Aug 15 18:08:11 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:08:11 user nova-compute[73007]:   </features>
Aug 15 18:08:11 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:08:11 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:08:11 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:08:11 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:08:11 user nova-compute[73007]:   </clock>
Aug 15 18:08:11 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:08:11 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:08:11 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:08:11 user nova-compute[73007]:   </cpu>
Aug 15 18:08:11 user nova-compute[73007]:   <devices>
Aug 15 18:08:11 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:08:11 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:08:11 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk"/>
Aug 15 18:08:11 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:08:11 user nova-compute[73007]:     </disk>
Aug 15 18:08:11 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:08:11 user nova-compute[73007]:       <mac address="fa:16:3e:8b:22:f2"/>
Aug 15 18:08:11 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:08:11 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:08:11 user nova-compute[73007]:       <target dev="tapdd923fa0-f7"/>
Aug 15 18:08:11 user nova-compute[73007]:     </interface>
Aug 15 18:08:11 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:08:11 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/console.log" append="off"/>
Aug 15 18:08:11 user nova-compute[73007]:     </serial>
Aug 15 18:08:11 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:08:11 user nova-compute[73007]:     <video>
Aug 15 18:08:11 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:08:11 user nova-compute[73007]:     </video>
Aug 15 18:08:11 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:08:11 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:08:11 user nova-compute[73007]:     </rng>
Aug 15 18:08:11 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:08:11 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:08:11 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:08:11 user nova-compute[73007]:     </memballoon>
Aug 15 18:08:11 user nova-compute[73007]:   </devices>
Aug 15 18:08:11 user nova-compute[73007]: </domain>
Aug 15 18:08:11 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1856518961',display_name='tempest-TestMinimumBasicScenario-server-1856518961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1856518961',id=48,image_ref='e7ca193d-4e89-4a1e-baed-7492855baaa2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOEWMhtx7yF9uY2ud4U5FBIhgETHwpEr2Hha5RM8E05U9EVXwhNtNuFChtE1j0+7jD79uMcr8ntxiEn38O8leCON2dEddAKLl29IGZ8TeHBMPPXdo0B1Q5LJc1oeUJxPg==',key_name='tempest-TestMinimumBasicScenario-1615031928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-seg7za4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e7ca193d-4e89-4a1e-baed-7492855baaa2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:08:08Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=e315d959-2703-4141-9517-461b29fa492b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=dd923fa0-f782-46e9-a52f-5d8042c5a906,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd923fa0-f7') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG os_vif [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=dd923fa0-f782-46e9-a52f-5d8042c5a906,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd923fa0-f7') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-a6a7abfd-55e3-4ead-806d-11281efc7b7f req-a4075043-7e38-4b78-bace-e2a5a292a60f service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updated VIF entry in instance network info cache for port 3e388fd1-eeef-4853-b992-91c420a3c694. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.network.neutron [req-a6a7abfd-55e3-4ead-806d-11281efc7b7f req-a4075043-7e38-4b78-bace-e2a5a292a60f service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updating instance_info_cache with network_info: [{"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd923fa0-f7, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd923fa0-f7, col_values=(('external_ids', {'iface-id': 'dd923fa0-f782-46e9-a52f-5d8042c5a906', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:22:f2', 'vm-uuid': 'e315d959-2703-4141-9517-461b29fa492b'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a6a7abfd-55e3-4ead-806d-11281efc7b7f req-a4075043-7e38-4b78-bace-e2a5a292a60f service nova] Releasing lock "refresh_cache-e80a756d-ec14-417e-8164-a1e9db7041d8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:11 user nova-compute[73007]: INFO os_vif [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=dd923fa0-f782-46e9-a52f-5d8042c5a906,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd923fa0-f7')
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:08:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No VIF found with MAC fa:16:3e:8b:22:f2, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-1995fc8c-b014-46cc-a268-7cea8dced179 req-46acc84c-8ced-44f6-8299-52f11ef1fd10 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updated VIF entry in instance network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-1995fc8c-b014-46cc-a268-7cea8dced179 req-46acc84c-8ced-44f6-8299-52f11ef1fd10 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1995fc8c-b014-46cc-a268-7cea8dced179 req-46acc84c-8ced-44f6-8299-52f11ef1fd10 service nova] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:08:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Instance destroyed successfully.
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lazy-loading 'resources' on Instance uuid e80a756d-ec14-417e-8164-a1e9db7041d8 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-78066264',display_name='tempest-TestVolumeBootPattern-server-78066264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-78066264',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzYXA6X6V+yeFYRZ9KXyoD+BucgdBkj+2ZJ7xUwbHJBrsKX3DAKx7lv/P9E1Ow61936X3iKVCnLSFzUgJ5BZOiudCazKAqX9S/Xveyp/yi0N66zCK/DnQrXgnzfzKMRrA==',key_name='tempest-TestVolumeBootPattern-1326671078',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:03:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6eebca3ef0a45788b0dfbc03b01fe8c',ramdisk_id='',reservation_id='r-j0ld6lg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-393609756',owner_user_name='tempest-TestVolumeBootPattern-393609756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:03:36Z,user_data=None,user_id='4cd910b3e8bf406f8512b3470f6eaca5',uuid=e80a756d-ec14-417e-8164-a1e9db7041d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converting VIF {"id": "3e388fd1-eeef-4853-b992-91c420a3c694", "address": "fa:16:3e:7d:54:a6", "network": {"id": "b5eabf49-5513-43a6-b6f8-5447c95e6b1f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2129430720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6eebca3ef0a45788b0dfbc03b01fe8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e388fd1-ee", "ovs_interfaceid": "3e388fd1-eeef-4853-b992-91c420a3c694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:54:a6,bridge_name='br-int',has_traffic_filtering=True,id=3e388fd1-eeef-4853-b992-91c420a3c694,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e388fd1-ee') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_vif [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:54:a6,bridge_name='br-int',has_traffic_filtering=True,id=3e388fd1-eeef-4853-b992-91c420a3c694,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e388fd1-ee') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e388fd1-ee, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:12 user nova-compute[73007]: INFO os_vif [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:54:a6,bridge_name='br-int',has_traffic_filtering=True,id=3e388fd1-eeef-4853-b992-91c420a3c694,network=Network(b5eabf49-5513-43a6-b6f8-5447c95e6b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e388fd1-ee')
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtHngFJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:08:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dd9b27-89c2-46c4-b2d7-6be410939d3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd9e02e-3693-4285-92ca-96c9e96b60f9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:08:12 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:08:12 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:08:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:08:12 user nova-compute[73007]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b (non-flash)
Aug 15 18:08:12 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:08:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c465ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b'): ({'sdf'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Removing single pathed devices sdf {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fae67f-3321-43a7-99eb-9957ef382e5a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[46efac47-56f3-4be7-98ee-045499666452]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Flushing IO for device /dev/sdf {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c97e14-fcdb-456d-8798-924aba2fae0a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.091s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd637b7-ed9a-4646-bf85-6106da99e98d]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] SCSI volumes sdf have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aafa172-a748-40db-b11c-bac8ea784658]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee44fa0b-313b-45a7-b4e5-e59baa527f5b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260]
Aug 15 18:08:12 user nova-compute[73007]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b, portal: 172.16.0.220,3260] successful.
Aug 15 18:08:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b1cb-b2a5-412b-b8bc-e631cb3b537b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe83d41-a7da-4dd5-807c-0d99e756b5f8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] <== disconnect_volume: return (352ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:08:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Deleting instance files /opt/stack/data/nova/instances/e80a756d-ec14-417e-8164-a1e9db7041d8_del
Aug 15 18:08:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Deletion of /opt/stack/data/nova/instances/e80a756d-ec14-417e-8164-a1e9db7041d8_del complete
Aug 15 18:08:12 user nova-compute[73007]: INFO nova.compute.manager [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Took 1.61 seconds to destroy the instance on the hypervisor.
Aug 15 18:08:12 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:08:12 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-vif-unplugged-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] Acquiring lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] No waiting events found dispatching network-vif-unplugged-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-vif-unplugged-3e388fd1-eeef-4853-b992-91c420a3c694 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] Acquiring lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] No waiting events found dispatching network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:08:13 user nova-compute[73007]: WARNING nova.compute.manager [req-8f63cc17-13eb-4e62-8d2d-4980202fc327 req-e3183a28-378d-4ebb-8b54-12ddbf200469 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received unexpected event network-vif-plugged-3e388fd1-eeef-4853-b992-91c420a3c694 for instance with vm_state active and task_state deleting.
Aug 15 18:08:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-a1fad64c-0309-447d-8617-bd5537c451a3 req-65583855-edce-4f3a-8043-b4f9dfd92188 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Received event network-vif-deleted-3e388fd1-eeef-4853-b992-91c420a3c694 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:13 user nova-compute[73007]: INFO nova.compute.manager [req-a1fad64c-0309-447d-8617-bd5537c451a3 req-65583855-edce-4f3a-8043-b4f9dfd92188 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Neutron deleted interface 3e388fd1-eeef-4853-b992-91c420a3c694; detaching it from the instance and deleting it from the info cache
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-a1fad64c-0309-447d-8617-bd5537c451a3 req-65583855-edce-4f3a-8043-b4f9dfd92188 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:08:13 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Took 0.58 seconds to deallocate network for instance.
Aug 15 18:08:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-a1fad64c-0309-447d-8617-bd5537c451a3 req-65583855-edce-4f3a-8043-b4f9dfd92188 service nova] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Detach interface failed, port_id=3e388fd1-eeef-4853-b992-91c420a3c694, reason: Instance e80a756d-ec14-417e-8164-a1e9db7041d8 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:14 user nova-compute[73007]: INFO nova.compute.manager [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Terminating instance
Aug 15 18:08:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:08:14 user nova-compute[73007]: INFO nova.compute.manager [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Took 0.98 seconds to detach 1 volumes for instance.
Aug 15 18:08:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:14 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Deleted allocations for instance e80a756d-ec14-417e-8164-a1e9db7041d8
Aug 15 18:08:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8074f229-b2bc-412a-9b83-104c4725a0e6 tempest-TestVolumeBootPattern-393609756 tempest-TestVolumeBootPattern-393609756-project-member] Lock "e80a756d-ec14-417e-8164-a1e9db7041d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.864s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Instance destroyed successfully.
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.objects.instance [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'resources' on Instance uuid d9648621-6b91-4028-9f89-83302bc7a8cd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1509921233',display_name='tempest-ServerRescueNegativeTestJSON-server-1509921233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1509921233',id=28,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-nsttvj8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:53:53Z,user_data=None,user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=d9648621-6b91-4028-9f89-83302bc7a8cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "d0452311-67f5-4735-b13c-a468d4b75e2d", "address": "fa:16:3e:70:ce:c8", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0452311-67", "ovs_interfaceid": "d0452311-67f5-4735-b13c-a468d4b75e2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:ce:c8,bridge_name='br-int',has_traffic_filtering=True,id=d0452311-67f5-4735-b13c-a468d4b75e2d,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0452311-67') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG os_vif [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:ce:c8,bridge_name='br-int',has_traffic_filtering=True,id=d0452311-67f5-4735-b13c-a468d4b75e2d,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0452311-67') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0452311-67, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:08:15 user nova-compute[73007]: INFO os_vif [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:ce:c8,bridge_name='br-int',has_traffic_filtering=True,id=d0452311-67f5-4735-b13c-a468d4b75e2d,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0452311-67')
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Deleting instance files /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd_del
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Deletion of /opt/stack/data/nova/instances/d9648621-6b91-4028-9f89-83302bc7a8cd_del complete
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] No waiting events found dispatching network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:08:15 user nova-compute[73007]: WARNING nova.compute.manager [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received unexpected event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 for instance with vm_state building and task_state spawning.
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] No waiting events found dispatching network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:08:15 user nova-compute[73007]: WARNING nova.compute.manager [req-465ef37b-0914-4fdc-bbe5-9e5d70556a1e req-5c52f617-0f9a-4737-a980-612d4f12ef36 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received unexpected event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 for instance with vm_state building and task_state spawning.
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.compute.manager [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-unplugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] No waiting events found dispatching network-vif-unplugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-unplugged-d0452311-67f5-4735-b13c-a468d4b75e2d for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] Acquiring lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] No waiting events found dispatching network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:08:15 user nova-compute[73007]: WARNING nova.compute.manager [req-8c9f41f7-3acb-4112-b879-20450cc9fb22 req-39ea31bb-d190-46e4-9b10-6005c2e735ec service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received unexpected event network-vif-plugged-d0452311-67f5-4735-b13c-a468d4b75e2d for instance with vm_state rescued and task_state deleting.
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122895.6747763, e315d959-2703-4141-9517-461b29fa492b => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] VM Resumed (Lifecycle Event)
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e315d959-2703-4141-9517-461b29fa492b] Instance spawned successfully.
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122895.6830573, e315d959-2703-4141-9517-461b29fa492b => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] VM Started (Lifecycle Event)
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Took 0.59 seconds to deallocate network for instance.
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Took 7.79 seconds to spawn the instance on the hypervisor.
Aug 15 18:08:15 user nova-compute[73007]: DEBUG nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:15 user nova-compute[73007]: INFO nova.compute.manager [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Took 8.68 seconds to build instance.
Aug 15 18:08:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-9cccb532-b314-4d19-ae85-b54fa1f6be89 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.778s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:16 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:08:16 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:08:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:16 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Deleted allocations for instance d9648621-6b91-4028-9f89-83302bc7a8cd
Aug 15 18:08:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-30e7efa4-4c48-472b-a3b2-186732a87f62 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "d9648621-6b91-4028-9f89-83302bc7a8cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-bcc3cc57-c103-4c71-a367-0a5f41474332 req-d3b5a4ca-d8f4-407f-8143-305065b19e6f service nova] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Received event network-vif-deleted-d0452311-67f5-4735-b13c-a468d4b75e2d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:18 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updating instance_info_cache with network_info: [{"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-c8047564-c2ee-43f4-b423-cc9c686eabc1" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:19 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:08:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=25.041229248046875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 582f3e3e-a05e-48dd-803d-b87a6eeda045 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance c8047564-c2ee-43f4-b423-cc9c686eabc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e315d959-2703-4141-9517-461b29fa492b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:23 user nova-compute[73007]: INFO nova.compute.manager [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Terminating instance
Aug 15 18:08:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-963dbc26-cf95-4523-8c32-b7f7f01dffa1 req-c5fd266c-11fe-4e58-91b9-1fdc92929a84 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-963dbc26-cf95-4523-8c32-b7f7f01dffa1 req-c5fd266c-11fe-4e58-91b9-1fdc92929a84 service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-963dbc26-cf95-4523-8c32-b7f7f01dffa1 req-c5fd266c-11fe-4e58-91b9-1fdc92929a84 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-963dbc26-cf95-4523-8c32-b7f7f01dffa1 req-c5fd266c-11fe-4e58-91b9-1fdc92929a84 service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-963dbc26-cf95-4523-8c32-b7f7f01dffa1 req-c5fd266c-11fe-4e58-91b9-1fdc92929a84 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-963dbc26-cf95-4523-8c32-b7f7f01dffa1 req-c5fd266c-11fe-4e58-91b9-1fdc92929a84 service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-unplugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Instance destroyed successfully.
Aug 15 18:08:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'resources' on Instance uuid c8047564-c2ee-43f4-b423-cc9c686eabc1 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-562465900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-562465900',id=29,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:54:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-c8534a7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:56:21Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=c8047564-c2ee-43f4-b423-cc9c686eabc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "a994297e-f116-4704-93f6-99f23e05ca85", "address": "fa:16:3e:22:7a:fe", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa994297e-f1", "ovs_interfaceid": "a994297e-f116-4704-93f6-99f23e05ca85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:7a:fe,bridge_name='br-int',has_traffic_filtering=True,id=a994297e-f116-4704-93f6-99f23e05ca85,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa994297e-f1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_vif [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:7a:fe,bridge_name='br-int',has_traffic_filtering=True,id=a994297e-f116-4704-93f6-99f23e05ca85,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa994297e-f1') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa994297e-f1, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:08:24 user nova-compute[73007]: INFO os_vif [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:7a:fe,bridge_name='br-int',has_traffic_filtering=True,id=a994297e-f116-4704-93f6-99f23e05ca85,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa994297e-f1')
Aug 15 18:08:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTqhdmxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:08:24 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1fc500-1065-45f0-a93f-c514df1c715c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e804c2-2a55-4858-bf6d-196ce91b027c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:08:24 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:08:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 (non-flash)
Aug 15 18:08:24 user nova-compute[73007]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:08:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c7e2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692'): ({'sdc'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Removing single pathed devices sdc {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caca971-94ed-49b7-bd7e-a688a76711fa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9900fe-eacf-44e6-9af7-21cff607289d]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Flushing IO for device /dev/sdc {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf19a9a-d7b0-464e-ad82-af01fdd100fc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[99791b87-1e51-481e-95d8-89ed3e394041]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a06b9b-be49-4e32-b9a5-e6a9e266542d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3ecee4-32df-420f-bd57-62394f8ca614]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692, portal: 172.16.0.220,3260]
Aug 15 18:08:24 user nova-compute[73007]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692, portal: 172.16.0.220,3260] successful.
Aug 15 18:08:24 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e90625eb-7440-48c6-8d3e-b9abdd875692 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff56777-dae4-4986-bbc8-7dc6128d1e8b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] <== disconnect_volume: return (299ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:08:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Deleting instance files /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1_del
Aug 15 18:08:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Deletion of /opt/stack/data/nova/instances/c8047564-c2ee-43f4-b423-cc9c686eabc1_del complete
Aug 15 18:08:24 user nova-compute[73007]: INFO nova.compute.manager [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 15 18:08:24 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:08:24 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:08:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:25 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:08:25 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Took 0.72 seconds to deallocate network for instance.
Aug 15 18:08:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-a15ddca0-2d9d-47c5-a501-8f7c7f3c3ba7 req-18656956-4ddc-47d6-8767-8bc037dceecc service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a15ddca0-2d9d-47c5-a501-8f7c7f3c3ba7 req-18656956-4ddc-47d6-8767-8bc037dceecc service nova] Acquiring lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a15ddca0-2d9d-47c5-a501-8f7c7f3c3ba7 req-18656956-4ddc-47d6-8767-8bc037dceecc service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a15ddca0-2d9d-47c5-a501-8f7c7f3c3ba7 req-18656956-4ddc-47d6-8767-8bc037dceecc service nova] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-a15ddca0-2d9d-47c5-a501-8f7c7f3c3ba7 req-18656956-4ddc-47d6-8767-8bc037dceecc service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] No waiting events found dispatching network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:08:25 user nova-compute[73007]: WARNING nova.compute.manager [req-a15ddca0-2d9d-47c5-a501-8f7c7f3c3ba7 req-18656956-4ddc-47d6-8767-8bc037dceecc service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received unexpected event network-vif-plugged-a994297e-f116-4704-93f6-99f23e05ca85 for instance with vm_state active and task_state deleting.
Aug 15 18:08:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-a15ddca0-2d9d-47c5-a501-8f7c7f3c3ba7 req-18656956-4ddc-47d6-8767-8bc037dceecc service nova] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Received event network-vif-deleted-a994297e-f116-4704-93f6-99f23e05ca85 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:08:26 user nova-compute[73007]: INFO nova.compute.manager [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Took 0.84 seconds to detach 1 volumes for instance.
Aug 15 18:08:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:08:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:08:26 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:08:26 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:08:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:26 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Deleted allocations for instance c8047564-c2ee-43f4-b423-cc9c686eabc1
Aug 15 18:08:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ce14e88b-e5ed-4190-901e-e730fd6d9440 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "c8047564-c2ee-43f4-b423-cc9c686eabc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.168s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:08:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:08:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:08:27 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122892.255046, e80a756d-ec14-417e-8164-a1e9db7041d8 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:08:27 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] VM Stopped (Lifecycle Event)
Aug 15 18:08:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-29a56563-fc20-41d6-8925-eb12b66db39e None None] [instance: e80a756d-ec14-417e-8164-a1e9db7041d8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:08:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:30 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122895.0560253, d9648621-6b91-4028-9f89-83302bc7a8cd => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:08:30 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] VM Stopped (Lifecycle Event)
Aug 15 18:08:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-f9711503-f4af-4396-bf0d-473ea5abe9b4 None None] [instance: d9648621-6b91-4028-9f89-83302bc7a8cd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:08:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:39 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122904.1896267, c8047564-c2ee-43f4-b423-cc9c686eabc1 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:08:39 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] VM Stopped (Lifecycle Event)
Aug 15 18:08:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-dcbbe35a-65d5-4896-b08b-e8d2de203980 None None] [instance: c8047564-c2ee-43f4-b423-cc9c686eabc1] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:08:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:08:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:04 user nova-compute[73007]: INFO nova.compute.manager [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Terminating instance
Aug 15 18:09:04 user nova-compute[73007]: DEBUG nova.compute.manager [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-8d46e42b-3a3c-42bb-ad86-b32a34bca0fe req-cdc92622-fc09-4579-946c-87dbba9d91f3 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8d46e42b-3a3c-42bb-ad86-b32a34bca0fe req-cdc92622-fc09-4579-946c-87dbba9d91f3 service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8d46e42b-3a3c-42bb-ad86-b32a34bca0fe req-cdc92622-fc09-4579-946c-87dbba9d91f3 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8d46e42b-3a3c-42bb-ad86-b32a34bca0fe req-cdc92622-fc09-4579-946c-87dbba9d91f3 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-8d46e42b-3a3c-42bb-ad86-b32a34bca0fe req-cdc92622-fc09-4579-946c-87dbba9d91f3 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.compute.manager [req-8d46e42b-3a3c-42bb-ad86-b32a34bca0fe req-cdc92622-fc09-4579-946c-87dbba9d91f3 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-unplugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:09:05 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Instance destroyed successfully.
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.objects.instance [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lazy-loading 'resources' on Instance uuid b8628c95-e352-41e4-b7d5-af0aa9ebcb0c {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1941915722',display_name='tempest-ServerRescueNegativeTestJSON-server-1941915722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1941915722',id=27,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:56:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f94edb7a50c4e0e97ddc96c5c0028fc',ramdisk_id='',reservation_id='r-daik9wph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1846740548',owner_user_name='tempest-ServerRescueNegativeTestJSON-1846740548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:58:39Z,user_data=None,user_id='f886ee6939504c4b9a406cedb9a65acc',uuid=b8628c95-e352-41e4-b7d5-af0aa9ebcb0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converting VIF {"id": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "address": "fa:16:3e:b7:f2:a6", "network": {"id": "1ee3705e-aca6-4e31-91c3-157f8d8c1a07", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2108117675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f94edb7a50c4e0e97ddc96c5c0028fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fec5233-53", "ovs_interfaceid": "9fec5233-53d4-4263-abd5-dd4e68a94c53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=9fec5233-53d4-4263-abd5-dd4e68a94c53,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec5233-53') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG os_vif [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=9fec5233-53d4-4263-abd5-dd4e68a94c53,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec5233-53') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fec5233-53, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:09:05 user nova-compute[73007]: INFO os_vif [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f2:a6,bridge_name='br-int',has_traffic_filtering=True,id=9fec5233-53d4-4263-abd5-dd4e68a94c53,network=Network(1ee3705e-aca6-4e31-91c3-157f8d8c1a07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fec5233-53')
Aug 15 18:09:05 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Deleting instance files /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c_del
Aug 15 18:09:05 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Deletion of /opt/stack/data/nova/instances/b8628c95-e352-41e4-b7d5-af0aa9ebcb0c_del complete
Aug 15 18:09:05 user nova-compute[73007]: INFO nova.compute.manager [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 18:09:05 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:09:05 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:09:06 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:09:06 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Took 0.51 seconds to deallocate network for instance.
Aug 15 18:09:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-e108a871-9361-42d0-8662-d8fd12ae7d26 req-09d64b19-71c7-4ec8-8fc9-081e3c66898c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-deleted-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:06 user nova-compute[73007]: INFO nova.compute.manager [req-e108a871-9361-42d0-8662-d8fd12ae7d26 req-09d64b19-71c7-4ec8-8fc9-081e3c66898c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Neutron deleted interface 9fec5233-53d4-4263-abd5-dd4e68a94c53; detaching it from the instance and deleting it from the info cache
Aug 15 18:09:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-e108a871-9361-42d0-8662-d8fd12ae7d26 req-09d64b19-71c7-4ec8-8fc9-081e3c66898c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:09:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-e108a871-9361-42d0-8662-d8fd12ae7d26 req-09d64b19-71c7-4ec8-8fc9-081e3c66898c service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Detach interface failed, port_id=9fec5233-53d4-4263-abd5-dd4e68a94c53, reason: Instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:09:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:06 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:09:06 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:09:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:06 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Deleted allocations for instance b8628c95-e352-41e4-b7d5-af0aa9ebcb0c
Aug 15 18:09:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-e239ea89-b114-468e-8ecd-a1ac27a775d6 tempest-ServerRescueNegativeTestJSON-1846740548 tempest-ServerRescueNegativeTestJSON-1846740548-project-member] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.725s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-3ed500a5-94ef-44ba-9df9-43a1938220d4 req-df2e1780-c964-4259-955e-f4bbc146b718 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3ed500a5-94ef-44ba-9df9-43a1938220d4 req-df2e1780-c964-4259-955e-f4bbc146b718 service nova] Acquiring lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3ed500a5-94ef-44ba-9df9-43a1938220d4 req-df2e1780-c964-4259-955e-f4bbc146b718 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-3ed500a5-94ef-44ba-9df9-43a1938220d4 req-df2e1780-c964-4259-955e-f4bbc146b718 service nova] Lock "b8628c95-e352-41e4-b7d5-af0aa9ebcb0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-3ed500a5-94ef-44ba-9df9-43a1938220d4 req-df2e1780-c964-4259-955e-f4bbc146b718 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] No waiting events found dispatching network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:09:07 user nova-compute[73007]: WARNING nova.compute.manager [req-3ed500a5-94ef-44ba-9df9-43a1938220d4 req-df2e1780-c964-4259-955e-f4bbc146b718 service nova] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Received unexpected event network-vif-plugged-9fec5233-53d4-4263-abd5-dd4e68a94c53 for instance with vm_state deleted and task_state None.
Aug 15 18:09:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:10 user nova-compute[73007]: INFO nova.compute.manager [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Terminating instance
Aug 15 18:09:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG nova.compute.manager [req-b2d79471-df9e-4bf2-8d85-b8e656e52ee7 req-90ae6910-0919-463f-85fb-1992aa34f158 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-unplugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b2d79471-df9e-4bf2-8d85-b8e656e52ee7 req-90ae6910-0919-463f-85fb-1992aa34f158 service nova] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b2d79471-df9e-4bf2-8d85-b8e656e52ee7 req-90ae6910-0919-463f-85fb-1992aa34f158 service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-b2d79471-df9e-4bf2-8d85-b8e656e52ee7 req-90ae6910-0919-463f-85fb-1992aa34f158 service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG nova.compute.manager [req-b2d79471-df9e-4bf2-8d85-b8e656e52ee7 req-90ae6910-0919-463f-85fb-1992aa34f158 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] No waiting events found dispatching network-vif-unplugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:09:10 user nova-compute[73007]: DEBUG nova.compute.manager [req-b2d79471-df9e-4bf2-8d85-b8e656e52ee7 req-90ae6910-0919-463f-85fb-1992aa34f158 service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-unplugged-96ecbd22-c121-40ce-8f58-9c14788d09fb for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:09:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Instance destroyed successfully.
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.objects.instance [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'resources' on Instance uuid 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1151877584',display_name='tempest-ServerActionsTestOtherA-server-1151877584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1151877584',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:04:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-18dn6xtt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=693cc4d3-51fc-4d13-b5aa-832d22b1ebdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "address": "fa:16:3e:29:55:3d", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ecbd22-c1", "ovs_interfaceid": "96ecbd22-c121-40ce-8f58-9c14788d09fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_vif [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96ecbd22-c1, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:11 user nova-compute[73007]: INFO os_vif [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:55:3d,bridge_name='br-int',has_traffic_filtering=True,id=96ecbd22-c121-40ce-8f58-9c14788d09fb,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ecbd22-c1')
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBNEeqIO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:09:11 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dab6f3-eeb0-4601-b473-3c80817e96fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d3aa08-5b3a-4e69-8341-4fde2d8b313d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:09:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef (non-flash)
Aug 15 18:09:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f115079d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef'): ({'sde'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Removing single pathed devices sde {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64c01d1-baf4-4a2d-979d-86860646aad0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[947f4363-d68f-4280-9056-5459647a19fe]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Flushing IO for device /dev/sde {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[83341018-b2b4-48ee-a148-c86fd50d046c]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.067s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1925892f-cad6-4c57-90fd-2a5b4a0659e9]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] SCSI volumes sde have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6b6c9c1a-f28f26aee329807a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6b6c9c1a', '/dev/disk/by-id/scsi-26632386632366165') {{(pid=84257) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0869f912-91dd-45fb-8c56-7f4804417445]: (4, None) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[50110b4e-f2cb-4e17-a41d-2ed6ff2dff4d]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[88764e95-4abb-4dea-9ed3-d29ba5501356]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260]
Aug 15 18:09:11 user nova-compute[73007]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef, portal: 172.16.0.220,3260] successful.
Aug 15 18:09:11 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66b06d0a-bef1-4068-bf1c-dfcb78d979ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783ab29-ce65-4d13-94ce-78b4b691af25]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] <== disconnect_volume: return (311ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:09:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Deleting instance files /opt/stack/data/nova/instances/693cc4d3-51fc-4d13-b5aa-832d22b1ebdd_del
Aug 15 18:09:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Deletion of /opt/stack/data/nova/instances/693cc4d3-51fc-4d13-b5aa-832d22b1ebdd_del complete
Aug 15 18:09:11 user nova-compute[73007]: INFO nova.compute.manager [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 15 18:09:11 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:09:11 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:09:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:12 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:09:12 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Took 1.06 seconds to deallocate network for instance.
Aug 15 18:09:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-c4172524-db26-4999-b8b8-822dabe10088 req-60b98fa6-b1af-4a9a-9386-85cc96cbe87a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-deleted-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:12 user nova-compute[73007]: INFO nova.compute.manager [req-c4172524-db26-4999-b8b8-822dabe10088 req-60b98fa6-b1af-4a9a-9386-85cc96cbe87a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Neutron deleted interface 96ecbd22-c121-40ce-8f58-9c14788d09fb; detaching it from the instance and deleting it from the info cache
Aug 15 18:09:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-c4172524-db26-4999-b8b8-822dabe10088 req-60b98fa6-b1af-4a9a-9386-85cc96cbe87a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:09:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-c4172524-db26-4999-b8b8-822dabe10088 req-60b98fa6-b1af-4a9a-9386-85cc96cbe87a service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Detach interface failed, port_id=96ecbd22-c121-40ce-8f58-9c14788d09fb, reason: Instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:09:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-632fb1db-8f47-4625-becf-25f9c1a4e020 req-b60af09c-96b9-4349-b1fd-a0179322c39e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-632fb1db-8f47-4625-becf-25f9c1a4e020 req-b60af09c-96b9-4349-b1fd-a0179322c39e service nova] Acquiring lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-632fb1db-8f47-4625-becf-25f9c1a4e020 req-b60af09c-96b9-4349-b1fd-a0179322c39e service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-632fb1db-8f47-4625-becf-25f9c1a4e020 req-b60af09c-96b9-4349-b1fd-a0179322c39e service nova] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-632fb1db-8f47-4625-becf-25f9c1a4e020 req-b60af09c-96b9-4349-b1fd-a0179322c39e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] No waiting events found dispatching network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:09:12 user nova-compute[73007]: WARNING nova.compute.manager [req-632fb1db-8f47-4625-becf-25f9c1a4e020 req-b60af09c-96b9-4349-b1fd-a0179322c39e service nova] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Received unexpected event network-vif-plugged-96ecbd22-c121-40ce-8f58-9c14788d09fb for instance with vm_state active and task_state deleting.
Aug 15 18:09:13 user nova-compute[73007]: INFO nova.compute.manager [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Took 0.77 seconds to detach 1 volumes for instance.
Aug 15 18:09:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Deleting volume: 66b06d0a-bef1-4068-bf1c-dfcb78d979ef {{(pid=73007) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 18:09:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:13 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:09:13 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:09:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:13 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Deleted allocations for instance 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd
Aug 15 18:09:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-0f89953a-3eda-49d4-96cf-655a16bd8578 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "693cc4d3-51fc-4d13-b5aa-832d22b1ebdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.647s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:14 user nova-compute[73007]: INFO nova.compute.manager [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Terminating instance
Aug 15 18:09:14 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f1b415b-1381-4d2b-847a-6b6761f40b0d req-91bee061-5562-4c42-8aff-ab3d6689613e service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received event network-vif-unplugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f1b415b-1381-4d2b-847a-6b6761f40b0d req-91bee061-5562-4c42-8aff-ab3d6689613e service nova] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f1b415b-1381-4d2b-847a-6b6761f40b0d req-91bee061-5562-4c42-8aff-ab3d6689613e service nova] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-1f1b415b-1381-4d2b-847a-6b6761f40b0d req-91bee061-5562-4c42-8aff-ab3d6689613e service nova] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f1b415b-1381-4d2b-847a-6b6761f40b0d req-91bee061-5562-4c42-8aff-ab3d6689613e service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] No waiting events found dispatching network-vif-unplugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:09:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-1f1b415b-1381-4d2b-847a-6b6761f40b0d req-91bee061-5562-4c42-8aff-ab3d6689613e service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received event network-vif-unplugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:09:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Instance destroyed successfully.
Aug 15 18:09:15 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lazy-loading 'resources' on Instance uuid 582f3e3e-a05e-48dd-803d-b87a6eeda045 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1562029046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1562029046',id=20,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:49:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e88231a35bb4a2e8b5e1e7d5e5f9418',ramdisk_id='',reservation_id='r-mau3pqp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-452961283',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:51:31Z,user_data=None,user_id='2b7b5264253d44e9a51d06f66bed1443',uuid=582f3e3e-a05e-48dd-803d-b87a6eeda045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converting VIF {"id": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "address": "fa:16:3e:09:4c:42", "network": {"id": "23dbc047-73ec-4737-b232-60dcd49d289a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-260531105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e88231a35bb4a2e8b5e1e7d5e5f9418", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55ac3f2c-af", "ovs_interfaceid": "55ac3f2c-af4d-4c2b-aae3-e5106fec4e21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:4c:42,bridge_name='br-int',has_traffic_filtering=True,id=55ac3f2c-af4d-4c2b-aae3-e5106fec4e21,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ac3f2c-af') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG os_vif [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4c:42,bridge_name='br-int',has_traffic_filtering=True,id=55ac3f2c-af4d-4c2b-aae3-e5106fec4e21,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ac3f2c-af') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55ac3f2c-af, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:09:15 user nova-compute[73007]: INFO os_vif [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4c:42,bridge_name='br-int',has_traffic_filtering=True,id=55ac3f2c-af4d-4c2b-aae3-e5106fec4e21,network=Network(23dbc047-73ec-4737-b232-60dcd49d289a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55ac3f2c-af')
Aug 15 18:09:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Deleting instance files /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045_del
Aug 15 18:09:15 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Deletion of /opt/stack/data/nova/instances/582f3e3e-a05e-48dd-803d-b87a6eeda045_del complete
Aug 15 18:09:15 user nova-compute[73007]: INFO nova.compute.manager [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:15 user nova-compute[73007]: INFO nova.compute.manager [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Unshelving
Aug 15 18:09:15 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:09:15 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Took 0.61 seconds to deallocate network for instance.
Aug 15 18:09:15 user nova-compute[73007]: INFO nova.virt.block_device [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Booting with volume c1c65230-5aae-4b4f-9515-f77dabf8fcce at /dev/vda
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG os_brick.utils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-b5962378-a51d-4f28-ae72-6d276fb93d24 req-b5aa84b0-4294-496d-9b75-3fa84c52d438 service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received event network-vif-deleted-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e84ccb-4343-406d-bd1c-b5982e5074fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e871b36b-1e6e-4831-9bd4-90b47c9297c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:15 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[48115445-32bc-4928-a9af-66c7203c7c26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d90d372-91bf-4247-81f2-c54aa6c4ba46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:09:16 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd942a7-9412-4aa1-becb-a49c2ee9e1f6]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG os_brick.utils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating existing volume attachment record: 39aefa54-e430-4786-8559-70920e3987a3 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:16 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Deleted allocations for instance 582f3e3e-a05e-48dd-803d-b87a6eeda045
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ebe31105-015d-4e6a-9476-eddc3ea33df4 tempest-ServerBootFromVolumeStableRescueTest-452961283 tempest-ServerBootFromVolumeStableRescueTest-452961283-project-member] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-f808e3b5-8745-4e36-a4a5-adaf9d9cb17f req-b5d1776a-863e-4a1a-9c6b-c39a15861cdb service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received event network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f808e3b5-8745-4e36-a4a5-adaf9d9cb17f req-b5d1776a-863e-4a1a-9c6b-c39a15861cdb service nova] Acquiring lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f808e3b5-8745-4e36-a4a5-adaf9d9cb17f req-b5d1776a-863e-4a1a-9c6b-c39a15861cdb service nova] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f808e3b5-8745-4e36-a4a5-adaf9d9cb17f req-b5d1776a-863e-4a1a-9c6b-c39a15861cdb service nova] Lock "582f3e3e-a05e-48dd-803d-b87a6eeda045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:16 user nova-compute[73007]: DEBUG nova.compute.manager [req-f808e3b5-8745-4e36-a4a5-adaf9d9cb17f req-b5d1776a-863e-4a1a-9c6b-c39a15861cdb service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] No waiting events found dispatching network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:09:16 user nova-compute[73007]: WARNING nova.compute.manager [req-f808e3b5-8745-4e36-a4a5-adaf9d9cb17f req-b5d1776a-863e-4a1a-9c6b-c39a15861cdb service nova] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Received unexpected event network-vif-plugged-55ac3f2c-af4d-4c2b-aae3-e5106fec4e21 for instance with vm_state deleted and task_state None.
Aug 15 18:09:18 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:20 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122945.4975574, b8628c95-e352-41e4-b7d5-af0aa9ebcb0c => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:09:20 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] VM Stopped (Lifecycle Event)
Aug 15 18:09:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-03ee4546-3855-4966-ab91-d0e4f68dfbab None None] [instance: b8628c95-e352-41e4-b7d5-af0aa9ebcb0c] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:09:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=25.164161682128906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance accaba3e-7f1d-4638-8338-453f429a0c40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e315d959-2703-4141-9517-461b29fa492b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 3cb91142-7140-45a7-8f42-d515c7ffb158 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 18:09:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 18:09:23 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 18:09:23 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:09:23 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:09:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:09:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lazy-loading 'pci_requests' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:09:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:09:24 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:09:24 user nova-compute[73007]: INFO nova.compute.claims [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Claim successful on node user
Aug 15 18:09:25 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:25 user nova-compute[73007]: INFO nova.network.neutron [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating port 70d465d4-7680-4c97-bdd8-06f77e426e2f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122951.0925102, 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:09:26 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] VM Stopped (Lifecycle Event)
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-34351d6e-07d5-4f00-b408-f8aa96d90860 None None] [instance: 693cc4d3-51fc-4d13-b5aa-832d22b1ebdd] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-d57e4d83-b8f8-409e-af70-0969542005bf req-6d650b43-1f22-45ce-bc95-9a728416ed1c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-d57e4d83-b8f8-409e-af70-0969542005bf req-6d650b43-1f22-45ce-bc95-9a728416ed1c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing instance network info cache due to event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d57e4d83-b8f8-409e-af70-0969542005bf req-6d650b43-1f22-45ce-bc95-9a728416ed1c service nova] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:09:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Creating image(s)
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Did not create local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Ensure instance console log exists: /opt/stack/data/nova/instances/3cb91142-7140-45a7-8f42-d515c7ffb158/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Start _get_guest_xml network_info=[{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFRPpDqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3cb91142-7140-45a7-8f42-d515c7ffb158', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1c65230-5aae-4b4f-9515-f77dabf8fcce', 'serial': 'c1c65230-5aae-4b4f-9515-f77dabf8fcce'}, 'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '39aefa54-e430-4786-8559-70920e3987a3', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d57e4d83-b8f8-409e-af70-0969542005bf req-6d650b43-1f22-45ce-bc95-9a728416ed1c service nova] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.network.neutron [req-d57e4d83-b8f8-409e-af70-0969542005bf req-6d650b43-1f22-45ce-bc95-9a728416ed1c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:09:26 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:09:26 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFRPpDqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:09:26 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:09:26 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:09:26 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[095ba6df-a5f4-4640-863f-366ad60b4bf5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:09:26 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa84b73-11c2-46d6-87c6-0452dcdbdd74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce] added
Aug 15 18:09:26 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da683d-b45c-44a3-b96c-1d6445ed4ab3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab9405-c044-47e9-84d0-e2f10be34a63]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFRPpDqz {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFRPpDqz" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e725de-b637-4cc1-aae2-dab21da20b0a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SFRPpDqz'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdbb9af-5ce3-4263-b7ea-4b50f3291459]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb6a4a6-c910-4c5c-b7f7-4d36de49f510]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:09:26 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:09:26 user nova-compute[73007]:  {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:09:26 user nova-compute[73007]: WARNING os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 18:09:26 user nova-compute[73007]: 
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5438f490-15af-48cd-acc3-8071675e07a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260]
Aug 15 18:09:26 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260] successful.
Aug 15 18:09:26 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2fd2ee-4c3e-46c5-9bb2-e797ea5207b0]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f1604d-d29b-4cc8-8588-d2464d6e8832]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:09:26 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:09:26 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b7370a-b3f4-430c-afc7-ab0d8a313f74]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFRPpDqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.network.neutron [req-d57e4d83-b8f8-409e-af70-0969542005bf req-6d650b43-1f22-45ce-bc95-9a728416ed1c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updated VIF entry in instance network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG nova.network.neutron [req-d57e4d83-b8f8-409e-af70-0969542005bf req-6d650b43-1f22-45ce-bc95-9a728416ed1c service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:09:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d57e4d83-b8f8-409e-af70-0969542005bf req-6d650b43-1f22-45ce-bc95-9a728416ed1c service nova] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23861363231356631', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861363231356631', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T18:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1555420845',display_name='tempest-TestShelveInstance-server-1555420845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1555420845',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-249784429',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:05:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='005b9f27d3394fe78f7998562bc76e7f',ramdisk_id='',reservation_id='r-mf3ssg2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1310135125',owner_user_name='tempest-TestShelveInstance-1310135125-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:09:16Z,user_data=None,user_id='e603d59405784668a5e1e1fa8d5ea8d0',uuid=3cb91142-7140-45a7-8f42-d515c7ffb158,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converting VIF {"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:09:27 user nova-compute[73007]:   <uuid>3cb91142-7140-45a7-8f42-d515c7ffb158</uuid>
Aug 15 18:09:27 user nova-compute[73007]:   <name>instance-0000002f</name>
Aug 15 18:09:27 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:09:27 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:09:27 user nova-compute[73007]:   <metadata>
Aug 15 18:09:27 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:09:27 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:09:27 user nova-compute[73007]:       <nova:name>tempest-TestShelveInstance-server-1555420845</nova:name>
Aug 15 18:09:27 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:09:26</nova:creationTime>
Aug 15 18:09:27 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:09:27 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:09:27 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:09:27 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:09:27 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:09:27 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:09:27 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:09:27 user nova-compute[73007]:       <nova:owner>
Aug 15 18:09:27 user nova-compute[73007]:         <nova:user uuid="e603d59405784668a5e1e1fa8d5ea8d0">tempest-TestShelveInstance-1310135125-project-member</nova:user>
Aug 15 18:09:27 user nova-compute[73007]:         <nova:project uuid="005b9f27d3394fe78f7998562bc76e7f">tempest-TestShelveInstance-1310135125</nova:project>
Aug 15 18:09:27 user nova-compute[73007]:       </nova:owner>
Aug 15 18:09:27 user nova-compute[73007]:       <nova:ports>
Aug 15 18:09:27 user nova-compute[73007]:         <nova:port uuid="70d465d4-7680-4c97-bdd8-06f77e426e2f">
Aug 15 18:09:27 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 18:09:27 user nova-compute[73007]:         </nova:port>
Aug 15 18:09:27 user nova-compute[73007]:       </nova:ports>
Aug 15 18:09:27 user nova-compute[73007]:     </nova:instance>
Aug 15 18:09:27 user nova-compute[73007]:   </metadata>
Aug 15 18:09:27 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:09:27 user nova-compute[73007]:     <system>
Aug 15 18:09:27 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:09:27 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:09:27 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:09:27 user nova-compute[73007]:       <entry name="serial">3cb91142-7140-45a7-8f42-d515c7ffb158</entry>
Aug 15 18:09:27 user nova-compute[73007]:       <entry name="uuid">3cb91142-7140-45a7-8f42-d515c7ffb158</entry>
Aug 15 18:09:27 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:09:27 user nova-compute[73007]:     </system>
Aug 15 18:09:27 user nova-compute[73007]:   </sysinfo>
Aug 15 18:09:27 user nova-compute[73007]:   <os>
Aug 15 18:09:27 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:09:27 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:09:27 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:09:27 user nova-compute[73007]:   </os>
Aug 15 18:09:27 user nova-compute[73007]:   <features>
Aug 15 18:09:27 user nova-compute[73007]:     <acpi/>
Aug 15 18:09:27 user nova-compute[73007]:     <apic/>
Aug 15 18:09:27 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:09:27 user nova-compute[73007]:   </features>
Aug 15 18:09:27 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:09:27 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:09:27 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:09:27 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:09:27 user nova-compute[73007]:   </clock>
Aug 15 18:09:27 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:09:27 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:09:27 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:09:27 user nova-compute[73007]:   </cpu>
Aug 15 18:09:27 user nova-compute[73007]:   <devices>
Aug 15 18:09:27 user nova-compute[73007]:     <disk type="block" device="disk">
Aug 15 18:09:27 user nova-compute[73007]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:09:27 user nova-compute[73007]:       <source dev="/dev/sdb"/>
Aug 15 18:09:27 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:09:27 user nova-compute[73007]:       <serial>c1c65230-5aae-4b4f-9515-f77dabf8fcce</serial>
Aug 15 18:09:27 user nova-compute[73007]:     </disk>
Aug 15 18:09:27 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:09:27 user nova-compute[73007]:       <mac address="fa:16:3e:bb:1b:bd"/>
Aug 15 18:09:27 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:09:27 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:09:27 user nova-compute[73007]:       <target dev="tap70d465d4-76"/>
Aug 15 18:09:27 user nova-compute[73007]:     </interface>
Aug 15 18:09:27 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:09:27 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/3cb91142-7140-45a7-8f42-d515c7ffb158/console.log" append="off"/>
Aug 15 18:09:27 user nova-compute[73007]:     </serial>
Aug 15 18:09:27 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:09:27 user nova-compute[73007]:     <video>
Aug 15 18:09:27 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:09:27 user nova-compute[73007]:     </video>
Aug 15 18:09:27 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:09:27 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:09:27 user nova-compute[73007]:     </rng>
Aug 15 18:09:27 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:09:27 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:09:27 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:09:27 user nova-compute[73007]:     </memballoon>
Aug 15 18:09:27 user nova-compute[73007]:   </devices>
Aug 15 18:09:27 user nova-compute[73007]: </domain>
Aug 15 18:09:27 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T18:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1555420845',display_name='tempest-TestShelveInstance-server-1555420845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1555420845',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-249784429',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:05:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='005b9f27d3394fe78f7998562bc76e7f',ramdisk_id='',reservation_id='r-mf3ssg2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1310135125',owner_user_name='tempest-TestShelveInstance-1310135125-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:09:16Z,user_data=None,user_id='e603d59405784668a5e1e1fa8d5ea8d0',uuid=3cb91142-7140-45a7-8f42-d515c7ffb158,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converting VIF {"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG os_vif [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70d465d4-76, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70d465d4-76, col_values=(('external_ids', {'iface-id': '70d465d4-7680-4c97-bdd8-06f77e426e2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:1b:bd', 'vm-uuid': '3cb91142-7140-45a7-8f42-d515c7ffb158'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:09:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:27 user nova-compute[73007]: INFO os_vif [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76')
Aug 15 18:09:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:09:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] No VIF found with MAC fa:16:3e:bb:1b:bd, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:09:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-aafc0165-d5f2-4378-af66-f16f6524bb75 req-d4c6dbe6-41af-4c50-83f4-3850f35e7653 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-aafc0165-d5f2-4378-af66-f16f6524bb75 req-d4c6dbe6-41af-4c50-83f4-3850f35e7653 service nova] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-aafc0165-d5f2-4378-af66-f16f6524bb75 req-d4c6dbe6-41af-4c50-83f4-3850f35e7653 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-aafc0165-d5f2-4378-af66-f16f6524bb75 req-d4c6dbe6-41af-4c50-83f4-3850f35e7653 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-aafc0165-d5f2-4378-af66-f16f6524bb75 req-d4c6dbe6-41af-4c50-83f4-3850f35e7653 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] No waiting events found dispatching network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:09:29 user nova-compute[73007]: WARNING nova.compute.manager [req-aafc0165-d5f2-4378-af66-f16f6524bb75 req-d4c6dbe6-41af-4c50-83f4-3850f35e7653 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received unexpected event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 18:09:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:30 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692122955.1058831, 582f3e3e-a05e-48dd-803d-b87a6eeda045 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:09:30 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] VM Stopped (Lifecycle Event)
Aug 15 18:09:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2ca27452-3ca5-4f14-ac7b-db3ea126a19d None None] [instance: 582f3e3e-a05e-48dd-803d-b87a6eeda045] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122971.3844872, 3cb91142-7140-45a7-8f42-d515c7ffb158 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:09:31 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] VM Resumed (Lifecycle Event)
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:09:31 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance spawned successfully.
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:09:31 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692122971.3892102, 3cb91142-7140-45a7-8f42-d515c7ffb158 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:09:31 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] VM Started (Lifecycle Event)
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-835343ba-a21b-4628-80f3-224f7cc7a65f tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.711s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-70f5b3d2-654b-4f0e-9f11-e8922f7a728d req-cadf86e9-64cd-45f1-b516-d35f5b543332 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-70f5b3d2-654b-4f0e-9f11-e8922f7a728d req-cadf86e9-64cd-45f1-b516-d35f5b543332 service nova] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-70f5b3d2-654b-4f0e-9f11-e8922f7a728d req-cadf86e9-64cd-45f1-b516-d35f5b543332 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-70f5b3d2-654b-4f0e-9f11-e8922f7a728d req-cadf86e9-64cd-45f1-b516-d35f5b543332 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:09:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-70f5b3d2-654b-4f0e-9f11-e8922f7a728d req-cadf86e9-64cd-45f1-b516-d35f5b543332 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] No waiting events found dispatching network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:09:31 user nova-compute[73007]: WARNING nova.compute.manager [req-70f5b3d2-654b-4f0e-9f11-e8922f7a728d req-cadf86e9-64cd-45f1-b516-d35f5b543332 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received unexpected event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f for instance with vm_state active and task_state None.
Aug 15 18:09:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:09:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:09:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:09:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:09:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:09:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:09:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:09:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:09:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:09:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:09:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:09:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:01 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'flavor' on Instance uuid e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:10:01 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:02 user nova-compute[73007]: INFO nova.compute.manager [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Attaching volume 652c3e6a-7eb8-4021-9436-c1723a880b04 to /dev/vdb
Aug 15 18:10:02 user nova-compute[73007]: DEBUG os_brick.utils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f56a945-a923-488b-8c05-d08a06b5989c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f09d4f5-b9a4-45fb-aa9c-35ed55d368f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f343f68-18c5-493b-aa92-c2408966ee3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a515a6f5-3b96-49b0-a7bf-994ea901b56c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:10:02 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:10:02 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9ed399-52f4-4e00-beb5-59cc93ae417c]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG os_brick.utils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating existing volume attachment record: dbbd5769-2983-435d-895f-fcbcc87e54fa {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:10:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "accaba3e-7f1d-4638-8338-453f429a0c40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "accaba3e-7f1d-4638-8338-453f429a0c40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:07 user nova-compute[73007]: INFO nova.compute.manager [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Terminating instance
Aug 15 18:10:07 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-c685f095-96b0-4e3e-ad09-afb68e272ee6 req-d0cee645-f023-412c-9192-210cb6f31acc service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-vif-unplugged-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c685f095-96b0-4e3e-ad09-afb68e272ee6 req-d0cee645-f023-412c-9192-210cb6f31acc service nova] Acquiring lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c685f095-96b0-4e3e-ad09-afb68e272ee6 req-d0cee645-f023-412c-9192-210cb6f31acc service nova] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c685f095-96b0-4e3e-ad09-afb68e272ee6 req-d0cee645-f023-412c-9192-210cb6f31acc service nova] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-c685f095-96b0-4e3e-ad09-afb68e272ee6 req-d0cee645-f023-412c-9192-210cb6f31acc service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] No waiting events found dispatching network-vif-unplugged-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG nova.compute.manager [req-c685f095-96b0-4e3e-ad09-afb68e272ee6 req-d0cee645-f023-412c-9192-210cb6f31acc service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-vif-unplugged-06d8a570-8b59-44eb-874e-55022131b039 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:10:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Instance destroyed successfully.
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lazy-loading 'resources' on Instance uuid accaba3e-7f1d-4638-8338-453f429a0c40 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T17:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1834821300',display_name='tempest-ServerActionsTestOtherA-server-1834821300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1834821300',id=24,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8gHBORUAGfotJBOZzm0RI913CsUfAy8mW8DvKmeQdMq1LzC/fIGiHz/yXRT29GYudWD3Z36QVRlpVlLPJ9DSNPDfvcZm2B9uGGRUoqUOd/a1+QJCujBD+jq5veVFGW4A==',key_name='tempest-keypair-1831422644',keypairs=<?>,launch_index=0,launched_at=2023-08-15T17:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09ba0a5fb91043d9a46323b202cd924c',ramdisk_id='',reservation_id='r-mwnkt1dr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226008880',owner_user_name='tempest-ServerActionsTestOtherA-226008880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T17:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52391420381427297cc8c55600112b0',uuid=accaba3e-7f1d-4638-8338-453f429a0c40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converting VIF {"id": "06d8a570-8b59-44eb-874e-55022131b039", "address": "fa:16:3e:22:6e:9a", "network": {"id": "05a5503f-eafc-4bd5-94c8-c6cc08ddaafc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1175629755-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09ba0a5fb91043d9a46323b202cd924c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06d8a570-8b", "ovs_interfaceid": "06d8a570-8b59-44eb-874e-55022131b039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:6e:9a,bridge_name='br-int',has_traffic_filtering=True,id=06d8a570-8b59-44eb-874e-55022131b039,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06d8a570-8b') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG os_vif [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:6e:9a,bridge_name='br-int',has_traffic_filtering=True,id=06d8a570-8b59-44eb-874e-55022131b039,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06d8a570-8b') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06d8a570-8b, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:08 user nova-compute[73007]: INFO os_vif [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:6e:9a,bridge_name='br-int',has_traffic_filtering=True,id=06d8a570-8b59-44eb-874e-55022131b039,network=Network(05a5503f-eafc-4bd5-94c8-c6cc08ddaafc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06d8a570-8b')
Aug 15 18:10:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Deleting instance files /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40_del
Aug 15 18:10:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Deletion of /opt/stack/data/nova/instances/accaba3e-7f1d-4638-8338-453f429a0c40_del complete
Aug 15 18:10:08 user nova-compute[73007]: INFO nova.compute.manager [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 18:10:08 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:10:08 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Took 0.57 seconds to deallocate network for instance.
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-a4a4a8da-a9f1-4767-b24e-f79bab8f3185 req-ac38b300-fbe2-4b7b-bc5f-636b2d5cf2d0 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-vif-deleted-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:08 user nova-compute[73007]: INFO nova.compute.manager [req-a4a4a8da-a9f1-4767-b24e-f79bab8f3185 req-ac38b300-fbe2-4b7b-bc5f-636b2d5cf2d0 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Neutron deleted interface 06d8a570-8b59-44eb-874e-55022131b039; detaching it from the instance and deleting it from the info cache
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.network.neutron [req-a4a4a8da-a9f1-4767-b24e-f79bab8f3185 req-ac38b300-fbe2-4b7b-bc5f-636b2d5cf2d0 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG nova.compute.manager [req-a4a4a8da-a9f1-4767-b24e-f79bab8f3185 req-ac38b300-fbe2-4b7b-bc5f-636b2d5cf2d0 service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Detach interface failed, port_id=06d8a570-8b59-44eb-874e-55022131b039, reason: Instance accaba3e-7f1d-4638-8338-453f429a0c40 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:08 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:09 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:10:09 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:10:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:09 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Deleted allocations for instance accaba3e-7f1d-4638-8338-453f429a0c40
Aug 15 18:10:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2ff01c60-8466-4f3b-8dc1-17e59a910cf2 tempest-ServerActionsTestOtherA-226008880 tempest-ServerActionsTestOtherA-226008880-project-member] Lock "accaba3e-7f1d-4638-8338-453f429a0c40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.954s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-ee2cede4-f07d-4f5d-a7e2-bb51afa5077b req-56d6e6d0-544c-420b-81c7-42482b172dbb service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received event network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ee2cede4-f07d-4f5d-a7e2-bb51afa5077b req-56d6e6d0-544c-420b-81c7-42482b172dbb service nova] Acquiring lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ee2cede4-f07d-4f5d-a7e2-bb51afa5077b req-56d6e6d0-544c-420b-81c7-42482b172dbb service nova] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ee2cede4-f07d-4f5d-a7e2-bb51afa5077b req-56d6e6d0-544c-420b-81c7-42482b172dbb service nova] Lock "accaba3e-7f1d-4638-8338-453f429a0c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-ee2cede4-f07d-4f5d-a7e2-bb51afa5077b req-56d6e6d0-544c-420b-81c7-42482b172dbb service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] No waiting events found dispatching network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:10:09 user nova-compute[73007]: WARNING nova.compute.manager [req-ee2cede4-f07d-4f5d-a7e2-bb51afa5077b req-56d6e6d0-544c-420b-81c7-42482b172dbb service nova] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Received unexpected event network-vif-plugged-06d8a570-8b59-44eb-874e-55022131b039 for instance with vm_state deleted and task_state None.
Aug 15 18:10:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMhneKdq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:10:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:10:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:10:12 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c491e6b-0530-4f21-919e-01b2b250478c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:10:12 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc65194-2ded-458a-851d-8070474d0114]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04] added
Aug 15 18:10:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb6d84f-5fc3-4e33-8a41-2e743be6b67a]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9464300-2203-4c16-a37f-2cc852f822c6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMhneKdq {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EMhneKdq" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06bff89-cb19-4c99-8d24-e1cd9ae01b47]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EMhneKdq'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b0b2d9-e00c-4fa0-960e-82d851380eef]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5604a7-3c27-4afa-9e1e-e0f931db4c7d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:10:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:10:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[201437e0-e246-4fe3-85b1-05215ad42f7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04, portal: 172.16.0.220,3260]
Aug 15 18:10:12 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04, portal: 172.16.0.220,3260] successful.
Aug 15 18:10:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[65893a2e-29da-4f52-b51a-a37ab22dab34]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43ae6e5-bb55-49ab-a14e-cbf3032ee02f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:10:12 user nova-compute[73007]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)
Aug 15 18:10:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:10:12 user nova-compute[73007]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)
Aug 15 18:10:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d39cc4-4b24-47c2-a9eb-143b0d9abea1]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMhneKdq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23439303039393362', 'path': '/dev/sdc'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439303039393362', 'path': '/dev/sdc'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'flavor' on Instance uuid e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:10:13 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:10:13 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 18:10:13 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:10:13 user nova-compute[73007]:   <serial>652c3e6a-7eb8-4021-9436-c1723a880b04</serial>
Aug 15 18:10:13 user nova-compute[73007]: </disk>
Aug 15 18:10:13 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] No VIF found with MAC fa:16:3e:8b:22:f2, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f9595f50-3209-496f-98ea-1db66b9ca0af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.934s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "e315d959-2703-4141-9517-461b29fa492b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.581s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "e315d959-2703-4141-9517-461b29fa492b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:16 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-0993c38c-03a8-4af8-91fd-d47233665e54 req-5e1f1b85-f95b-4cb2-b10f-384732d8a3ba service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-0993c38c-03a8-4af8-91fd-d47233665e54 req-5e1f1b85-f95b-4cb2-b10f-384732d8a3ba service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing instance network info cache due to event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:10:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0993c38c-03a8-4af8-91fd-d47233665e54 req-5e1f1b85-f95b-4cb2-b10f-384732d8a3ba service nova] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:10:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0993c38c-03a8-4af8-91fd-d47233665e54 req-5e1f1b85-f95b-4cb2-b10f-384732d8a3ba service nova] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:10:17 user nova-compute[73007]: DEBUG nova.network.neutron [req-0993c38c-03a8-4af8-91fd-d47233665e54 req-5e1f1b85-f95b-4cb2-b10f-384732d8a3ba service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:10:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:18 user nova-compute[73007]: DEBUG nova.network.neutron [req-0993c38c-03a8-4af8-91fd-d47233665e54 req-5e1f1b85-f95b-4cb2-b10f-384732d8a3ba service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updated VIF entry in instance network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:10:18 user nova-compute[73007]: DEBUG nova.network.neutron [req-0993c38c-03a8-4af8-91fd-d47233665e54 req-5e1f1b85-f95b-4cb2-b10f-384732d8a3ba service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:10:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0993c38c-03a8-4af8-91fd-d47233665e54 req-5e1f1b85-f95b-4cb2-b10f-384732d8a3ba service nova] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:10:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-11306a56-3fe0-43ff-b03e-02ead3187293 req-5055aa98-74b2-4f16-bc66-28fcde2c7005 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-11306a56-3fe0-43ff-b03e-02ead3187293 req-5055aa98-74b2-4f16-bc66-28fcde2c7005 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing instance network info cache due to event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:10:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-11306a56-3fe0-43ff-b03e-02ead3187293 req-5055aa98-74b2-4f16-bc66-28fcde2c7005 service nova] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:10:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-11306a56-3fe0-43ff-b03e-02ead3187293 req-5055aa98-74b2-4f16-bc66-28fcde2c7005 service nova] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:10:19 user nova-compute[73007]: DEBUG nova.network.neutron [req-11306a56-3fe0-43ff-b03e-02ead3187293 req-5055aa98-74b2-4f16-bc66-28fcde2c7005 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:20 user nova-compute[73007]: INFO nova.compute.manager [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Rebooting instance
Aug 15 18:10:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-11306a56-3fe0-43ff-b03e-02ead3187293 req-5055aa98-74b2-4f16-bc66-28fcde2c7005 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updated VIF entry in instance network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-11306a56-3fe0-43ff-b03e-02ead3187293 req-5055aa98-74b2-4f16-bc66-28fcde2c7005 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-11306a56-3fe0-43ff-b03e-02ead3187293 req-5055aa98-74b2-4f16-bc66-28fcde2c7005 service nova] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG nova.network.neutron [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:10:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:10:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:10:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:10:22 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:10:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=25.180370330810547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e315d959-2703-4141-9517-461b29fa492b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance 3cb91142-7140-45a7-8f42-d515c7ffb158 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:10:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692123008.1046395, accaba3e-7f1d-4638-8338-453f429a0c40 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:10:23 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] VM Stopped (Lifecycle Event)
Aug 15 18:10:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-6e7f847f-0b5f-4ee6-9677-6368e1a59a1b None None] [instance: accaba3e-7f1d-4638-8338-453f429a0c40] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-e17beac9-d12b-41d0-b143-f203a8413f61 req-494d23b8-d260-47eb-a0ca-9c197e99d477 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-unplugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e17beac9-d12b-41d0-b143-f203a8413f61 req-494d23b8-d260-47eb-a0ca-9c197e99d477 service nova] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e17beac9-d12b-41d0-b143-f203a8413f61 req-494d23b8-d260-47eb-a0ca-9c197e99d477 service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-e17beac9-d12b-41d0-b143-f203a8413f61 req-494d23b8-d260-47eb-a0ca-9c197e99d477 service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-e17beac9-d12b-41d0-b143-f203a8413f61 req-494d23b8-d260-47eb-a0ca-9c197e99d477 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] No waiting events found dispatching network-vif-unplugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:10:24 user nova-compute[73007]: WARNING nova.compute.manager [req-e17beac9-d12b-41d0-b143-f203a8413f61 req-494d23b8-d260-47eb-a0ca-9c197e99d477 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received unexpected event network-vif-unplugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 for instance with vm_state active and task_state reboot_started.
Aug 15 18:10:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:10:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Instance shutdown successfully.
Aug 15 18:10:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:10:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:10:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] No waiting events found dispatching network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:10:26 user nova-compute[73007]: WARNING nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received unexpected event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 for instance with vm_state active and task_state reboot_started.
Aug 15 18:10:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] No waiting events found dispatching network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:10:26 user nova-compute[73007]: WARNING nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received unexpected event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 for instance with vm_state active and task_state reboot_started.
Aug 15 18:10:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] No waiting events found dispatching network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:10:26 user nova-compute[73007]: WARNING nova.compute.manager [req-d0305455-8f4b-4215-85cd-7a5e36390140 req-5883a26d-b230-45dc-8877-4d89b98431bf service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received unexpected event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 for instance with vm_state active and task_state reboot_started.
Aug 15 18:10:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Removed pending event for e315d959-2703-4141-9517-461b29fa492b due to event {{(pid=73007) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 18:10:27 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123027.7384472, e315d959-2703-4141-9517-461b29fa492b => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:10:27 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] VM Resumed (Lifecycle Event)
Aug 15 18:10:27 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e315d959-2703-4141-9517-461b29fa492b] Instance running successfully.
Aug 15 18:10:27 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Instance soft rebooted successfully.
Aug 15 18:10:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:10:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:10:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:10:27 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 18:10:27 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123027.7395265, e315d959-2703-4141-9517-461b29fa492b => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:10:27 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] VM Started (Lifecycle Event)
Aug 15 18:10:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:10:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-d3df87f1-b08c-4090-9490-af0a1cf23128 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.390s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:10:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:10:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:10:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:10:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:10:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:10:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:10:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:10:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:10:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:06 user nova-compute[73007]: INFO nova.compute.manager [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Terminating instance
Aug 15 18:11:06 user nova-compute[73007]: DEBUG nova.compute.manager [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-ecf01863-f096-461c-88f4-fee330e97df5 req-e55b2027-7c0a-4439-9cb5-f3a4917f92f2 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG nova.compute.manager [req-ecf01863-f096-461c-88f4-fee330e97df5 req-e55b2027-7c0a-4439-9cb5-f3a4917f92f2 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing instance network info cache due to event network-changed-70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ecf01863-f096-461c-88f4-fee330e97df5 req-e55b2027-7c0a-4439-9cb5-f3a4917f92f2 service nova] Acquiring lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ecf01863-f096-461c-88f4-fee330e97df5 req-e55b2027-7c0a-4439-9cb5-f3a4917f92f2 service nova] Acquired lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG nova.network.neutron [req-ecf01863-f096-461c-88f4-fee330e97df5 req-e55b2027-7c0a-4439-9cb5-f3a4917f92f2 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Refreshing network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-ecf01863-f096-461c-88f4-fee330e97df5 req-e55b2027-7c0a-4439-9cb5-f3a4917f92f2 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updated VIF entry in instance network info cache for port 70d465d4-7680-4c97-bdd8-06f77e426e2f. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG nova.network.neutron [req-ecf01863-f096-461c-88f4-fee330e97df5 req-e55b2027-7c0a-4439-9cb5-f3a4917f92f2 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [{"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ecf01863-f096-461c-88f4-fee330e97df5 req-e55b2027-7c0a-4439-9cb5-f3a4917f92f2 service nova] Releasing lock "refresh_cache-3cb91142-7140-45a7-8f42-d515c7ffb158" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:11:07 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Instance destroyed successfully.
Aug 15 18:11:07 user nova-compute[73007]: DEBUG nova.objects.instance [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lazy-loading 'resources' on Instance uuid 3cb91142-7140-45a7-8f42-d515c7ffb158 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T18:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1555420845',display_name='tempest-TestShelveInstance-server-1555420845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1555420845',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Uy7J7kEGqI576s+LbH3MCZFhYymIIQh/NtmKCy09E5kh0EHjfLzTqoLSdwzJFvliG8DKTbZV+03bDKw2UhygRVGqzr+pdlg/XGYzPaUKs0lz1NfTKG51DZvT04CCY3A==',key_name='tempest-TestShelveInstance-249784429',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:09:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='005b9f27d3394fe78f7998562bc76e7f',ramdisk_id='',reservation_id='r-mf3ssg2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1310135125',owner_user_name='tempest-TestShelveInstance-1310135125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:09:31Z,user_data=None,user_id='e603d59405784668a5e1e1fa8d5ea8d0',uuid=3cb91142-7140-45a7-8f42-d515c7ffb158,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converting VIF {"id": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "address": "fa:16:3e:bb:1b:bd", "network": {"id": "6604929f-7fff-4f29-ac74-78788e6480df", "bridge": "br-int", "label": "tempest-TestShelveInstance-251420925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "005b9f27d3394fe78f7998562bc76e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70d465d4-76", "ovs_interfaceid": "70d465d4-7680-4c97-bdd8-06f77e426e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_vif [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70d465d4-76, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:11:07 user nova-compute[73007]: INFO os_vif [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:1b:bd,bridge_name='br-int',has_traffic_filtering=True,id=70d465d4-7680-4c97-bdd8-06f77e426e2f,network=Network(6604929f-7fff-4f29-ac74-78788e6480df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70d465d4-76')
Aug 15 18:11:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFRPpDqz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:11:07 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b2b25a-7350-4027-a0bd-08752ad9388c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c85286-8157-4a3f-aad1-a99b60df49f3]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:11:07 user nova-compute[73007]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)
Aug 15 18:11:07 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce (non-flash)
Aug 15 18:11:07 user nova-compute[73007]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)
Aug 15 18:11:07 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c57e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50705a3-5409-4b9b-8cac-d84f5827e5f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a45bb37-5898-45cd-b3c0-04f9418f97ef]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[049585ad-b7f1-47d8-96ef-e7892ba4da7f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[722cc2c0-5b33-4fd3-8eae-241afb3d245b]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e559d9f9', '/dev/disk/by-id/scsi-1SCST_BIOe559d9f9-8a6215f1f3bdfb21', '/dev/disk/by-id/scsi-23861363231356631') {{(pid=84257) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[37157551-b3e6-49ca-a2d9-b2c9df6069e6]: (4, None) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af79db-0850-40e1-be88-57600c5b46bc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd3ba1-2700-4808-aee3-261e0f5ba19f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260]
Aug 15 18:11:07 user nova-compute[73007]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce, portal: 172.16.0.220,3260] successful.
Aug 15 18:11:07 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:11:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1c65230-5aae-4b4f-9515-f77dabf8fcce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[171da91b-1756-46f9-81bb-8b1d4a8e966e]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] <== disconnect_volume: return (355ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:11:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Deleting instance files /opt/stack/data/nova/instances/3cb91142-7140-45a7-8f42-d515c7ffb158_del
Aug 15 18:11:08 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Deletion of /opt/stack/data/nova/instances/3cb91142-7140-45a7-8f42-d515c7ffb158_del complete
Aug 15 18:11:08 user nova-compute[73007]: INFO nova.compute.manager [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 15 18:11:08 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:08 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:11:08 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Took 0.83 seconds to deallocate network for instance.
Aug 15 18:11:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-23fb6f25-f340-4abf-acb8-46a49d006176 req-1034cfb0-8f1e-4583-8099-e58d9924dc21 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-deleted-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-unplugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] No waiting events found dispatching network-vif-unplugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-unplugged-70d465d4-7680-4c97-bdd8-06f77e426e2f for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] Acquiring lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:09 user nova-compute[73007]: DEBUG nova.compute.manager [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] No waiting events found dispatching network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:11:09 user nova-compute[73007]: WARNING nova.compute.manager [req-0e7e0795-c3f6-4f82-8650-fec242471172 req-d0164899-25a4-44bf-b402-596c23390630 service nova] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Received unexpected event network-vif-plugged-70d465d4-7680-4c97-bdd8-06f77e426e2f for instance with vm_state active and task_state deleting.
Aug 15 18:11:10 user nova-compute[73007]: INFO nova.compute.manager [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Took 1.16 seconds to detach 1 volumes for instance.
Aug 15 18:11:10 user nova-compute[73007]: DEBUG nova.compute.manager [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Deleting volume: c1c65230-5aae-4b4f-9515-f77dabf8fcce {{(pid=73007) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 18:11:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:10 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:11:10 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:11:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:10 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Deleted allocations for instance 3cb91142-7140-45a7-8f42-d515c7ffb158
Aug 15 18:11:10 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-46e88307-9fc7-4537-b7f1-abfa476e6c00 tempest-TestShelveInstance-1310135125 tempest-TestShelveInstance-1310135125-project-member] Lock "3cb91142-7140-45a7-8f42-d515c7ffb158" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.848s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:12 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:11:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:12 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:11:12 user nova-compute[73007]: INFO nova.compute.claims [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Claim successful on node user
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:11:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.policy [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f2549603e934b3390bc22d8d3e6bbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3d4c73f1fd43239bb0a8c8ddb0868e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:11:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Creating image(s)
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "/opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "/opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.215s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.209s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk 1073741824" returned: 0 in 0.057s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.232s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Successfully created port: 522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Cannot resize image /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lazy-loading 'migration_context' on Instance uuid d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Ensure instance console log exists: /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:15 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Successfully updated port: 522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:11:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:11:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquired lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:11:15 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:11:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-de667a19-a2e4-48ce-8e1a-b4a6641ca8f9 req-43345500-7214-4f84-af48-d75c00880e18 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received event network-changed-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:15 user nova-compute[73007]: DEBUG nova.compute.manager [req-de667a19-a2e4-48ce-8e1a-b4a6641ca8f9 req-43345500-7214-4f84-af48-d75c00880e18 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Refreshing instance network info cache due to event network-changed-522613a7-b2cf-4f85-b62a-2b4e1ac6da44. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:11:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-de667a19-a2e4-48ce-8e1a-b4a6641ca8f9 req-43345500-7214-4f84-af48-d75c00880e18 service nova] Acquiring lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:11:15 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.network.neutron [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updating instance_info_cache with network_info: [{"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Releasing lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Instance network_info: |[{"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-de667a19-a2e4-48ce-8e1a-b4a6641ca8f9 req-43345500-7214-4f84-af48-d75c00880e18 service nova] Acquired lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.network.neutron [req-de667a19-a2e4-48ce-8e1a-b4a6641ca8f9 req-43345500-7214-4f84-af48-d75c00880e18 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Refreshing network info cache for port 522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Start _get_guest_xml network_info=[{"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:11:16 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:11:16 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1867859681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1867859681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1867859',id=49,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISaGJsYmoLxynOO0gnXpDggPCzANQZDUgQ4L3lqRMKMGAx3hIbMc9ZjHekyKIvaV5HXcO3MWWHTa2SLCbvCeAwBtFeMAW35HBvzzInMCy85Fh4DsIh1r8tb5aaxdoHbVQ==',key_name='tempest-keypair-258257796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3d4c73f1fd43239bb0a8c8ddb0868e',ramdisk_id='',reservation_id='r-v7qnurpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1992269513',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2549603e934b3390bc22d8d3e6bbfa',uuid=d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Converting VIF {"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=522613a7-b2cf-4f85-b62a-2b4e1ac6da44,network=Network(8fc75e6f-16be-4448-ac3b-12ef86da7afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap522613a7-b2') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.objects.instance [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lazy-loading 'pci_devices' on Instance uuid d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:11:16 user nova-compute[73007]:   <uuid>d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442</uuid>
Aug 15 18:11:16 user nova-compute[73007]:   <name>instance-00000031</name>
Aug 15 18:11:16 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:11:16 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:11:16 user nova-compute[73007]:   <metadata>
Aug 15 18:11:16 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:11:16 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:11:16 user nova-compute[73007]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1867859681</nova:name>
Aug 15 18:11:16 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:11:16</nova:creationTime>
Aug 15 18:11:16 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:11:16 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:11:16 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:11:16 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:11:16 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:11:16 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:11:16 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:11:16 user nova-compute[73007]:       <nova:owner>
Aug 15 18:11:16 user nova-compute[73007]:         <nova:user uuid="0f2549603e934b3390bc22d8d3e6bbfa">tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member</nova:user>
Aug 15 18:11:16 user nova-compute[73007]:         <nova:project uuid="1c3d4c73f1fd43239bb0a8c8ddb0868e">tempest-TestServerVolumeAttachScenarioOldVersion-1992269513</nova:project>
Aug 15 18:11:16 user nova-compute[73007]:       </nova:owner>
Aug 15 18:11:16 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:11:16 user nova-compute[73007]:       <nova:ports>
Aug 15 18:11:16 user nova-compute[73007]:         <nova:port uuid="522613a7-b2cf-4f85-b62a-2b4e1ac6da44">
Aug 15 18:11:16 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 18:11:16 user nova-compute[73007]:         </nova:port>
Aug 15 18:11:16 user nova-compute[73007]:       </nova:ports>
Aug 15 18:11:16 user nova-compute[73007]:     </nova:instance>
Aug 15 18:11:16 user nova-compute[73007]:   </metadata>
Aug 15 18:11:16 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:11:16 user nova-compute[73007]:     <system>
Aug 15 18:11:16 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:11:16 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:11:16 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:11:16 user nova-compute[73007]:       <entry name="serial">d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442</entry>
Aug 15 18:11:16 user nova-compute[73007]:       <entry name="uuid">d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442</entry>
Aug 15 18:11:16 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:11:16 user nova-compute[73007]:     </system>
Aug 15 18:11:16 user nova-compute[73007]:   </sysinfo>
Aug 15 18:11:16 user nova-compute[73007]:   <os>
Aug 15 18:11:16 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:11:16 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:11:16 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:11:16 user nova-compute[73007]:   </os>
Aug 15 18:11:16 user nova-compute[73007]:   <features>
Aug 15 18:11:16 user nova-compute[73007]:     <acpi/>
Aug 15 18:11:16 user nova-compute[73007]:     <apic/>
Aug 15 18:11:16 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:11:16 user nova-compute[73007]:   </features>
Aug 15 18:11:16 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:11:16 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:11:16 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:11:16 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:11:16 user nova-compute[73007]:   </clock>
Aug 15 18:11:16 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:11:16 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:11:16 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:11:16 user nova-compute[73007]:   </cpu>
Aug 15 18:11:16 user nova-compute[73007]:   <devices>
Aug 15 18:11:16 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:11:16 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:11:16 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk"/>
Aug 15 18:11:16 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:11:16 user nova-compute[73007]:     </disk>
Aug 15 18:11:16 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:11:16 user nova-compute[73007]:       <mac address="fa:16:3e:b7:01:a9"/>
Aug 15 18:11:16 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:11:16 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:11:16 user nova-compute[73007]:       <target dev="tap522613a7-b2"/>
Aug 15 18:11:16 user nova-compute[73007]:     </interface>
Aug 15 18:11:16 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:11:16 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/console.log" append="off"/>
Aug 15 18:11:16 user nova-compute[73007]:     </serial>
Aug 15 18:11:16 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:11:16 user nova-compute[73007]:     <video>
Aug 15 18:11:16 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:11:16 user nova-compute[73007]:     </video>
Aug 15 18:11:16 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:11:16 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:11:16 user nova-compute[73007]:     </rng>
Aug 15 18:11:16 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:11:16 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:11:16 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:11:16 user nova-compute[73007]:     </memballoon>
Aug 15 18:11:16 user nova-compute[73007]:   </devices>
Aug 15 18:11:16 user nova-compute[73007]: </domain>
Aug 15 18:11:16 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1867859681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1867859681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1867859',id=49,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISaGJsYmoLxynOO0gnXpDggPCzANQZDUgQ4L3lqRMKMGAx3hIbMc9ZjHekyKIvaV5HXcO3MWWHTa2SLCbvCeAwBtFeMAW35HBvzzInMCy85Fh4DsIh1r8tb5aaxdoHbVQ==',key_name='tempest-keypair-258257796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3d4c73f1fd43239bb0a8c8ddb0868e',ramdisk_id='',reservation_id='r-v7qnurpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1992269513',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2549603e934b3390bc22d8d3e6bbfa',uuid=d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Converting VIF {"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=522613a7-b2cf-4f85-b62a-2b4e1ac6da44,network=Network(8fc75e6f-16be-4448-ac3b-12ef86da7afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap522613a7-b2') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG os_vif [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=522613a7-b2cf-4f85-b62a-2b4e1ac6da44,network=Network(8fc75e6f-16be-4448-ac3b-12ef86da7afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap522613a7-b2') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap522613a7-b2, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap522613a7-b2, col_values=(('external_ids', {'iface-id': '522613a7-b2cf-4f85-b62a-2b4e1ac6da44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:01:a9', 'vm-uuid': 'd6e2a45b-4e8e-4ed1-87a3-ad92c6de3442'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:16 user nova-compute[73007]: INFO os_vif [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=522613a7-b2cf-4f85-b62a-2b4e1ac6da44,network=Network(8fc75e6f-16be-4448-ac3b-12ef86da7afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap522613a7-b2')
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] No VIF found with MAC fa:16:3e:b7:01:a9, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.network.neutron [req-de667a19-a2e4-48ce-8e1a-b4a6641ca8f9 req-43345500-7214-4f84-af48-d75c00880e18 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updated VIF entry in instance network info cache for port 522613a7-b2cf-4f85-b62a-2b4e1ac6da44. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG nova.network.neutron [req-de667a19-a2e4-48ce-8e1a-b4a6641ca8f9 req-43345500-7214-4f84-af48-d75c00880e18 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updating instance_info_cache with network_info: [{"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:11:16 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-de667a19-a2e4-48ce-8e1a-b4a6641ca8f9 req-43345500-7214-4f84-af48-d75c00880e18 service nova] Releasing lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:11:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "abd297b4-0aac-4c37-9b07-927b11a753f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-d4617196-a97a-4a11-a877-4645f01b2894 req-3d7d9f75-f645-49ef-84e3-12d1dc023bec service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received event network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d4617196-a97a-4a11-a877-4645f01b2894 req-3d7d9f75-f645-49ef-84e3-12d1dc023bec service nova] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d4617196-a97a-4a11-a877-4645f01b2894 req-3d7d9f75-f645-49ef-84e3-12d1dc023bec service nova] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d4617196-a97a-4a11-a877-4645f01b2894 req-3d7d9f75-f645-49ef-84e3-12d1dc023bec service nova] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.compute.manager [req-d4617196-a97a-4a11-a877-4645f01b2894 req-3d7d9f75-f645-49ef-84e3-12d1dc023bec service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] No waiting events found dispatching network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:11:18 user nova-compute[73007]: WARNING nova.compute.manager [req-d4617196-a97a-4a11-a877-4645f01b2894 req-3d7d9f75-f645-49ef-84e3-12d1dc023bec service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received unexpected event network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 for instance with vm_state building and task_state spawning.
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:11:18 user nova-compute[73007]: INFO nova.compute.claims [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Claim successful on node user
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:11:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.policy [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9389eded2194f4fb3cf788f2ebddcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e7f81225b54c3e8881b62c6a62d8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:11:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Creating image(s)
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "/opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "/opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "/opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:18 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk 1073741824" returned: 0 in 0.066s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Successfully created port: 74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Cannot resize image /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lazy-loading 'migration_context' on Instance uuid abd297b4-0aac-4c37-9b07-927b11a753f6 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Ensure instance console log exists: /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123079.9241366, d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:11:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] VM Resumed (Lifecycle Event)
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:11:19 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Instance spawned successfully.
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:11:19 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123079.9268868, d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:11:19 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] VM Started (Lifecycle Event)
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:11:20 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:11:20 user nova-compute[73007]: INFO nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Took 6.75 seconds to spawn the instance on the hypervisor.
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-a43c1618-2e34-471b-b6b5-ce059331efc2 req-d9435256-8a49-4288-bc61-602f7c75d55e service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received event network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a43c1618-2e34-471b-b6b5-ce059331efc2 req-d9435256-8a49-4288-bc61-602f7c75d55e service nova] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a43c1618-2e34-471b-b6b5-ce059331efc2 req-d9435256-8a49-4288-bc61-602f7c75d55e service nova] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-a43c1618-2e34-471b-b6b5-ce059331efc2 req-d9435256-8a49-4288-bc61-602f7c75d55e service nova] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-a43c1618-2e34-471b-b6b5-ce059331efc2 req-d9435256-8a49-4288-bc61-602f7c75d55e service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] No waiting events found dispatching network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:11:20 user nova-compute[73007]: WARNING nova.compute.manager [req-a43c1618-2e34-471b-b6b5-ce059331efc2 req-d9435256-8a49-4288-bc61-602f7c75d55e service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received unexpected event network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 for instance with vm_state building and task_state spawning.
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Successfully updated port: 74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:11:20 user nova-compute[73007]: INFO nova.compute.manager [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Took 7.38 seconds to build instance.
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "refresh_cache-abd297b4-0aac-4c37-9b07-927b11a753f6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquired lock "refresh_cache-abd297b4-0aac-4c37-9b07-927b11a753f6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-4945decd-45cf-42ba-8ebd-ba57ac47291a req-bbfdfb65-44f3-49d6-b316-948c647a6ea9 service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received event network-changed-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.compute.manager [req-4945decd-45cf-42ba-8ebd-ba57ac47291a req-bbfdfb65-44f3-49d6-b316-948c647a6ea9 service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Refreshing instance network info cache due to event network-changed-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4945decd-45cf-42ba-8ebd-ba57ac47291a req-bbfdfb65-44f3-49d6-b316-948c647a6ea9 service nova] Acquiring lock "refresh_cache-abd297b4-0aac-4c37-9b07-927b11a753f6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-b4e4e380-2eee-4d90-bef1-eac3cf642820 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.542s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.neutron [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Updating instance_info_cache with network_info: [{"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Releasing lock "refresh_cache-abd297b4-0aac-4c37-9b07-927b11a753f6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Instance network_info: |[{"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4945decd-45cf-42ba-8ebd-ba57ac47291a req-bbfdfb65-44f3-49d6-b316-948c647a6ea9 service nova] Acquired lock "refresh_cache-abd297b4-0aac-4c37-9b07-927b11a753f6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.neutron [req-4945decd-45cf-42ba-8ebd-ba57ac47291a req-bbfdfb65-44f3-49d6-b316-948c647a6ea9 service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Refreshing network info cache for port 74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Start _get_guest_xml network_info=[{"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:11:20 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:11:20 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-316018389',display_name='tempest-VolumesActionsTest-instance-316018389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-316018389',id=50,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66e7f81225b54c3e8881b62c6a62d8fd',ramdisk_id='',reservation_id='r-tgplztjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2015943328',owner_user_name='tempest-VolumesActionsTest-2015943328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:11:19Z,user_data=None,user_id='b9389eded2194f4fb3cf788f2ebddcc3',uuid=abd297b4-0aac-4c37-9b07-927b11a753f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Converting VIF {"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=74e2b1e9-9e11-4f29-9d1f-0891c233ec5a,network=Network(6ba694db-afc3-4222-bb07-8e284c002e14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e2b1e9-9e') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lazy-loading 'pci_devices' on Instance uuid abd297b4-0aac-4c37-9b07-927b11a753f6 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:11:20 user nova-compute[73007]:   <uuid>abd297b4-0aac-4c37-9b07-927b11a753f6</uuid>
Aug 15 18:11:20 user nova-compute[73007]:   <name>instance-00000032</name>
Aug 15 18:11:20 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:11:20 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:11:20 user nova-compute[73007]:   <metadata>
Aug 15 18:11:20 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:11:20 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:11:20 user nova-compute[73007]:       <nova:name>tempest-VolumesActionsTest-instance-316018389</nova:name>
Aug 15 18:11:20 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:11:20</nova:creationTime>
Aug 15 18:11:20 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:11:20 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:11:20 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:11:20 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:11:20 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:11:20 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:11:20 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:11:20 user nova-compute[73007]:       <nova:owner>
Aug 15 18:11:20 user nova-compute[73007]:         <nova:user uuid="b9389eded2194f4fb3cf788f2ebddcc3">tempest-VolumesActionsTest-2015943328-project-member</nova:user>
Aug 15 18:11:20 user nova-compute[73007]:         <nova:project uuid="66e7f81225b54c3e8881b62c6a62d8fd">tempest-VolumesActionsTest-2015943328</nova:project>
Aug 15 18:11:20 user nova-compute[73007]:       </nova:owner>
Aug 15 18:11:20 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:11:20 user nova-compute[73007]:       <nova:ports>
Aug 15 18:11:20 user nova-compute[73007]:         <nova:port uuid="74e2b1e9-9e11-4f29-9d1f-0891c233ec5a">
Aug 15 18:11:20 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 18:11:20 user nova-compute[73007]:         </nova:port>
Aug 15 18:11:20 user nova-compute[73007]:       </nova:ports>
Aug 15 18:11:20 user nova-compute[73007]:     </nova:instance>
Aug 15 18:11:20 user nova-compute[73007]:   </metadata>
Aug 15 18:11:20 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:11:20 user nova-compute[73007]:     <system>
Aug 15 18:11:20 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:11:20 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:11:20 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:11:20 user nova-compute[73007]:       <entry name="serial">abd297b4-0aac-4c37-9b07-927b11a753f6</entry>
Aug 15 18:11:20 user nova-compute[73007]:       <entry name="uuid">abd297b4-0aac-4c37-9b07-927b11a753f6</entry>
Aug 15 18:11:20 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:11:20 user nova-compute[73007]:     </system>
Aug 15 18:11:20 user nova-compute[73007]:   </sysinfo>
Aug 15 18:11:20 user nova-compute[73007]:   <os>
Aug 15 18:11:20 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:11:20 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:11:20 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:11:20 user nova-compute[73007]:   </os>
Aug 15 18:11:20 user nova-compute[73007]:   <features>
Aug 15 18:11:20 user nova-compute[73007]:     <acpi/>
Aug 15 18:11:20 user nova-compute[73007]:     <apic/>
Aug 15 18:11:20 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:11:20 user nova-compute[73007]:   </features>
Aug 15 18:11:20 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:11:20 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:11:20 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:11:20 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:11:20 user nova-compute[73007]:   </clock>
Aug 15 18:11:20 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:11:20 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:11:20 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:11:20 user nova-compute[73007]:   </cpu>
Aug 15 18:11:20 user nova-compute[73007]:   <devices>
Aug 15 18:11:20 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:11:20 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:11:20 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk"/>
Aug 15 18:11:20 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:11:20 user nova-compute[73007]:     </disk>
Aug 15 18:11:20 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:11:20 user nova-compute[73007]:       <mac address="fa:16:3e:f0:e9:31"/>
Aug 15 18:11:20 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:11:20 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:11:20 user nova-compute[73007]:       <target dev="tap74e2b1e9-9e"/>
Aug 15 18:11:20 user nova-compute[73007]:     </interface>
Aug 15 18:11:20 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:11:20 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/console.log" append="off"/>
Aug 15 18:11:20 user nova-compute[73007]:     </serial>
Aug 15 18:11:20 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:11:20 user nova-compute[73007]:     <video>
Aug 15 18:11:20 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:11:20 user nova-compute[73007]:     </video>
Aug 15 18:11:20 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:11:20 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:11:20 user nova-compute[73007]:     </rng>
Aug 15 18:11:20 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:11:20 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:11:20 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:11:20 user nova-compute[73007]:     </memballoon>
Aug 15 18:11:20 user nova-compute[73007]:   </devices>
Aug 15 18:11:20 user nova-compute[73007]: </domain>
Aug 15 18:11:20 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-316018389',display_name='tempest-VolumesActionsTest-instance-316018389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-316018389',id=50,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66e7f81225b54c3e8881b62c6a62d8fd',ramdisk_id='',reservation_id='r-tgplztjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2015943328',owner_user_name='tempest-VolumesActionsTest-2015943328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:11:19Z,user_data=None,user_id='b9389eded2194f4fb3cf788f2ebddcc3',uuid=abd297b4-0aac-4c37-9b07-927b11a753f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Converting VIF {"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=74e2b1e9-9e11-4f29-9d1f-0891c233ec5a,network=Network(6ba694db-afc3-4222-bb07-8e284c002e14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e2b1e9-9e') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG os_vif [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=74e2b1e9-9e11-4f29-9d1f-0891c233ec5a,network=Network(6ba694db-afc3-4222-bb07-8e284c002e14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e2b1e9-9e') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74e2b1e9-9e, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74e2b1e9-9e, col_values=(('external_ids', {'iface-id': '74e2b1e9-9e11-4f29-9d1f-0891c233ec5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e9:31', 'vm-uuid': 'abd297b4-0aac-4c37-9b07-927b11a753f6'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:20 user nova-compute[73007]: INFO os_vif [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=74e2b1e9-9e11-4f29-9d1f-0891c233ec5a,network=Network(6ba694db-afc3-4222-bb07-8e284c002e14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e2b1e9-9e')
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:11:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] No VIF found with MAC fa:16:3e:f0:e9:31, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:11:21 user nova-compute[73007]: DEBUG nova.network.neutron [req-4945decd-45cf-42ba-8ebd-ba57ac47291a req-bbfdfb65-44f3-49d6-b316-948c647a6ea9 service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Updated VIF entry in instance network info cache for port 74e2b1e9-9e11-4f29-9d1f-0891c233ec5a. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:11:21 user nova-compute[73007]: DEBUG nova.network.neutron [req-4945decd-45cf-42ba-8ebd-ba57ac47291a req-bbfdfb65-44f3-49d6-b316-948c647a6ea9 service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Updating instance_info_cache with network_info: [{"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:11:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4945decd-45cf-42ba-8ebd-ba57ac47291a req-bbfdfb65-44f3-49d6-b316-948c647a6ea9 service nova] Releasing lock "refresh_cache-abd297b4-0aac-4c37-9b07-927b11a753f6" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692123067.6006691, 3cb91142-7140-45a7-8f42-d515c7ffb158 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:11:22 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] VM Stopped (Lifecycle Event)
Aug 15 18:11:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1fe577c3-f7e8-413e-8f23-96551127e8b0 None None] [instance: 3cb91142-7140-45a7-8f42-d515c7ffb158] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-2440053d-a62c-47e9-9562-dd35e8201d20 req-a9f87e93-a041-4b12-9ca9-6ef9b4a8b447 service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received event network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2440053d-a62c-47e9-9562-dd35e8201d20 req-a9f87e93-a041-4b12-9ca9-6ef9b4a8b447 service nova] Acquiring lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2440053d-a62c-47e9-9562-dd35e8201d20 req-a9f87e93-a041-4b12-9ca9-6ef9b4a8b447 service nova] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-2440053d-a62c-47e9-9562-dd35e8201d20 req-a9f87e93-a041-4b12-9ca9-6ef9b4a8b447 service nova] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-2440053d-a62c-47e9-9562-dd35e8201d20 req-a9f87e93-a041-4b12-9ca9-6ef9b4a8b447 service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] No waiting events found dispatching network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:11:23 user nova-compute[73007]: WARNING nova.compute.manager [req-2440053d-a62c-47e9-9562-dd35e8201d20 req-a9f87e93-a041-4b12-9ca9-6ef9b4a8b447 service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received unexpected event network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a for instance with vm_state building and task_state spawning.
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:23 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123084.4550989, abd297b4-0aac-4c37-9b07-927b11a753f6 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:11:24 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] VM Resumed (Lifecycle Event)
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:11:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Instance spawned successfully.
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:11:24 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123084.456242, abd297b4-0aac-4c37-9b07-927b11a753f6 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:11:24 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] VM Started (Lifecycle Event)
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:11:24 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:11:24 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:11:25 user nova-compute[73007]: INFO nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:11:25 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:11:25 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=25.16492462158203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:25 user nova-compute[73007]: INFO nova.compute.manager [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Took 7.07 seconds to build instance.
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e315d959-2703-4141-9517-461b29fa492b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance abd297b4-0aac-4c37-9b07-927b11a753f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a6e1fc06-3f74-43eb-a809-8a82a7507aba tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.202s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-27a31279-8b48-4069-83ca-9ae9b539882a req-2f14253d-9f02-4576-bbca-2c09ca9a97cd service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received event network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-27a31279-8b48-4069-83ca-9ae9b539882a req-2f14253d-9f02-4576-bbca-2c09ca9a97cd service nova] Acquiring lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-27a31279-8b48-4069-83ca-9ae9b539882a req-2f14253d-9f02-4576-bbca-2c09ca9a97cd service nova] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-27a31279-8b48-4069-83ca-9ae9b539882a req-2f14253d-9f02-4576-bbca-2c09ca9a97cd service nova] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:11:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-27a31279-8b48-4069-83ca-9ae9b539882a req-2f14253d-9f02-4576-bbca-2c09ca9a97cd service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] No waiting events found dispatching network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:11:25 user nova-compute[73007]: WARNING nova.compute.manager [req-27a31279-8b48-4069-83ca-9ae9b539882a req-2f14253d-9f02-4576-bbca-2c09ca9a97cd service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received unexpected event network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a for instance with vm_state active and task_state None.
Aug 15 18:11:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:11:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:11:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:11:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:12:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-9e5f39c0-fe99-4963-8d95-53a8b1d1ed08 req-fb6d1453-fbc9-4d64-ad83-61a6cb99e314 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:12:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-9e5f39c0-fe99-4963-8d95-53a8b1d1ed08 req-fb6d1453-fbc9-4d64-ad83-61a6cb99e314 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing instance network info cache due to event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:12:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e5f39c0-fe99-4963-8d95-53a8b1d1ed08 req-fb6d1453-fbc9-4d64-ad83-61a6cb99e314 service nova] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:12:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e5f39c0-fe99-4963-8d95-53a8b1d1ed08 req-fb6d1453-fbc9-4d64-ad83-61a6cb99e314 service nova] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:12:12 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e5f39c0-fe99-4963-8d95-53a8b1d1ed08 req-fb6d1453-fbc9-4d64-ad83-61a6cb99e314 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e5f39c0-fe99-4963-8d95-53a8b1d1ed08 req-fb6d1453-fbc9-4d64-ad83-61a6cb99e314 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updated VIF entry in instance network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-9e5f39c0-fe99-4963-8d95-53a8b1d1ed08 req-fb6d1453-fbc9-4d64-ad83-61a6cb99e314 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-9e5f39c0-fe99-4963-8d95-53a8b1d1ed08 req-fb6d1453-fbc9-4d64-ad83-61a6cb99e314 service nova] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-defc29ba-efb1-446e-b08a-2ff737d1f71a req-a1ebe5e5-3cd1-4813-bf02-0d9b4df4aaf1 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-defc29ba-efb1-446e-b08a-2ff737d1f71a req-a1ebe5e5-3cd1-4813-bf02-0d9b4df4aaf1 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing instance network info cache due to event network-changed-dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-defc29ba-efb1-446e-b08a-2ff737d1f71a req-a1ebe5e5-3cd1-4813-bf02-0d9b4df4aaf1 service nova] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-defc29ba-efb1-446e-b08a-2ff737d1f71a req-a1ebe5e5-3cd1-4813-bf02-0d9b4df4aaf1 service nova] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-defc29ba-efb1-446e-b08a-2ff737d1f71a req-a1ebe5e5-3cd1-4813-bf02-0d9b4df4aaf1 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Refreshing network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:12:13 user nova-compute[73007]: INFO nova.compute.manager [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Detaching volume 652c3e6a-7eb8-4021-9436-c1723a880b04
Aug 15 18:12:13 user nova-compute[73007]: INFO nova.virt.block_device [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Attempting to driver detach volume 652c3e6a-7eb8-4021-9436-c1723a880b04 from mountpoint /dev/vdb
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Attempting to detach device vdb from instance e315d959-2703-4141-9517-461b29fa492b from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:12:13 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:12:13 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 18:12:13 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:12:13 user nova-compute[73007]:   <serial>652c3e6a-7eb8-4021-9436-c1723a880b04</serial>
Aug 15 18:12:13 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:12:13 user nova-compute[73007]: </disk>
Aug 15 18:12:13 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:12:13 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully detached device vdb from instance e315d959-2703-4141-9517-461b29fa492b from the persistent domain config.
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e315d959-2703-4141-9517-461b29fa492b from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:12:13 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:12:13 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:12:13 user nova-compute[73007]:   <source dev="/dev/sdc"/>
Aug 15 18:12:13 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:12:13 user nova-compute[73007]:   <serial>652c3e6a-7eb8-4021-9436-c1723a880b04</serial>
Aug 15 18:12:13 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:12:13 user nova-compute[73007]: </disk>
Aug 15 18:12:13 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-defc29ba-efb1-446e-b08a-2ff737d1f71a req-a1ebe5e5-3cd1-4813-bf02-0d9b4df4aaf1 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updated VIF entry in instance network info cache for port dd923fa0-f782-46e9-a52f-5d8042c5a906. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG nova.network.neutron [req-defc29ba-efb1-446e-b08a-2ff737d1f71a req-a1ebe5e5-3cd1-4813-bf02-0d9b4df4aaf1 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-defc29ba-efb1-446e-b08a-2ff737d1f71a req-a1ebe5e5-3cd1-4813-bf02-0d9b4df4aaf1 service nova] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692123134.4600387, e315d959-2703-4141-9517-461b29fa492b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:12:14 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully detached device vdb from instance e315d959-2703-4141-9517-461b29fa492b from the live domain config.
Aug 15 18:12:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EMhneKdq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:12:14 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[85296ba3-8bfe-4419-afe5-646bb1135213]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[420b331c-d4ef-4173-9e82-5bc9bb55d15b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)
Aug 15 18:12:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 (non-flash)
Aug 15 18:12:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f11619d9d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04'): ({'sdc'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Removing single pathed devices sdc {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7180202e-56b4-4f39-94e1-a9796ba519ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d99851-1323-4317-ab59-28a8d23f790e]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Flushing IO for device /dev/sdc {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc71bc9-c2b8-40a7-9dca-cc6af6190268]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ad4819-5d8c-4c90-b82a-1a3857626308]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] SCSI volumes sdc have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[057dcce4-6ba5-47b8-aaa9-839587e5d889]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4f06e-f917-405c-8685-a82eab38cec9]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04, portal: 172.16.0.220,3260]
Aug 15 18:12:14 user nova-compute[73007]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04, portal: 172.16.0.220,3260] successful.
Aug 15 18:12:14 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:652c3e6a-7eb8-4021-9436-c1723a880b04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f11dbdb-28ad-415d-ac70-1b82d5e60df8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] <== disconnect_volume: return (306ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:12:14 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:12:15 user nova-compute[73007]: DEBUG nova.objects.instance [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'flavor' on Instance uuid e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:12:15 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-f3b3adc4-2f1a-4bd2-a04b-5dcef05a0807 tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:12:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:12:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [{"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-e315d959-2703-4141-9517-461b29fa492b" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:12:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:12:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:12:26 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:12:26 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:12:26 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8334MB free_disk=25.098098754882812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:12:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:12:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance e315d959-2703-4141-9517-461b29fa492b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance abd297b4-0aac-4c37-9b07-927b11a753f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:12:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:12:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:12:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:12:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:12:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:12:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:12:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:12:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:12:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:12:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:12:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:13:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:13:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:13:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:13:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:13:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:13:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-91d74d49-c837-4116-b210-576a2a4db2b0 req-f26423a0-ef9b-4e13-bb78-f163d856e369 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received event network-changed-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:13:03 user nova-compute[73007]: DEBUG nova.compute.manager [req-91d74d49-c837-4116-b210-576a2a4db2b0 req-f26423a0-ef9b-4e13-bb78-f163d856e369 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Refreshing instance network info cache due to event network-changed-522613a7-b2cf-4f85-b62a-2b4e1ac6da44. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:13:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-91d74d49-c837-4116-b210-576a2a4db2b0 req-f26423a0-ef9b-4e13-bb78-f163d856e369 service nova] Acquiring lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:13:03 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-91d74d49-c837-4116-b210-576a2a4db2b0 req-f26423a0-ef9b-4e13-bb78-f163d856e369 service nova] Acquired lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:13:03 user nova-compute[73007]: DEBUG nova.network.neutron [req-91d74d49-c837-4116-b210-576a2a4db2b0 req-f26423a0-ef9b-4e13-bb78-f163d856e369 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Refreshing network info cache for port 522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:13:04 user nova-compute[73007]: DEBUG nova.network.neutron [req-91d74d49-c837-4116-b210-576a2a4db2b0 req-f26423a0-ef9b-4e13-bb78-f163d856e369 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updated VIF entry in instance network info cache for port 522613a7-b2cf-4f85-b62a-2b4e1ac6da44. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:13:04 user nova-compute[73007]: DEBUG nova.network.neutron [req-91d74d49-c837-4116-b210-576a2a4db2b0 req-f26423a0-ef9b-4e13-bb78-f163d856e369 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updating instance_info_cache with network_info: [{"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:13:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-91d74d49-c837-4116-b210-576a2a4db2b0 req-f26423a0-ef9b-4e13-bb78-f163d856e369 service nova] Releasing lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:13:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:07 user nova-compute[73007]: DEBUG nova.objects.instance [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lazy-loading 'flavor' on Instance uuid d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:13:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:07 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:07 user nova-compute[73007]: INFO nova.compute.manager [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Attaching volume 26ee8db5-68ff-4325-8193-84c502470497 to /dev/vdb
Aug 15 18:13:08 user nova-compute[73007]: DEBUG os_brick.utils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[923547f5-ba6f-4ad1-8db0-206c153902d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e645d-9a04-4ae1-bf4e-e9ddbc6c3876]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02e8be1-0aa5-476a-95ed-091733cd2997]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[952ea92c-367f-4b24-b411-5469dd903e88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:13:08 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:13:08 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10a922c-c895-45b5-9ad8-12fa96e4710a]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG os_brick.utils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updating existing volume attachment record: e2ff7140-f942-49ee-99dd-98a9e01286ae {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:13:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:11 user nova-compute[73007]: INFO nova.compute.manager [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Terminating instance
Aug 15 18:13:11 user nova-compute[73007]: DEBUG nova.compute.manager [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-f147253b-d39e-4bc6-b35c-91a99184846c req-660edf83-7fdc-488c-85c2-42ffd8c3105e service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-unplugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f147253b-d39e-4bc6-b35c-91a99184846c req-660edf83-7fdc-488c-85c2-42ffd8c3105e service nova] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f147253b-d39e-4bc6-b35c-91a99184846c req-660edf83-7fdc-488c-85c2-42ffd8c3105e service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f147253b-d39e-4bc6-b35c-91a99184846c req-660edf83-7fdc-488c-85c2-42ffd8c3105e service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-f147253b-d39e-4bc6-b35c-91a99184846c req-660edf83-7fdc-488c-85c2-42ffd8c3105e service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] No waiting events found dispatching network-vif-unplugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.compute.manager [req-f147253b-d39e-4bc6-b35c-91a99184846c req-660edf83-7fdc-488c-85c2-42ffd8c3105e service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-unplugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: e315d959-2703-4141-9517-461b29fa492b] Instance destroyed successfully.
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.objects.instance [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lazy-loading 'resources' on Instance uuid e315d959-2703-4141-9517-461b29fa492b {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1856518961',display_name='tempest-TestMinimumBasicScenario-server-1856518961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1856518961',id=48,image_ref='e7ca193d-4e89-4a1e-baed-7492855baaa2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOEWMhtx7yF9uY2ud4U5FBIhgETHwpEr2Hha5RM8E05U9EVXwhNtNuFChtE1j0+7jD79uMcr8ntxiEn38O8leCON2dEddAKLl29IGZ8TeHBMPPXdo0B1Q5LJc1oeUJxPg==',key_name='tempest-TestMinimumBasicScenario-1615031928',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:08:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06843dd305d24f79b1aa4f4772322248',ramdisk_id='',reservation_id='r-seg7za4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e7ca193d-4e89-4a1e-baed-7492855baaa2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1021033428',owner_user_name='tempest-TestMinimumBasicScenario-1021033428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:10:28Z,user_data=None,user_id='60ec8200260d42b7bdb788b3f745eb84',uuid=e315d959-2703-4141-9517-461b29fa492b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converting VIF {"id": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "address": "fa:16:3e:8b:22:f2", "network": {"id": "c7a854c0-2f05-4d88-bc07-71f51405fc5e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1898689930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06843dd305d24f79b1aa4f4772322248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd923fa0-f7", "ovs_interfaceid": "dd923fa0-f782-46e9-a52f-5d8042c5a906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=dd923fa0-f782-46e9-a52f-5d8042c5a906,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd923fa0-f7') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG os_vif [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=dd923fa0-f782-46e9-a52f-5d8042c5a906,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd923fa0-f7') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd923fa0-f7, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:13:12 user nova-compute[73007]: INFO os_vif [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:22:f2,bridge_name='br-int',has_traffic_filtering=True,id=dd923fa0-f782-46e9-a52f-5d8042c5a906,network=Network(c7a854c0-2f05-4d88-bc07-71f51405fc5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd923fa0-f7')
Aug 15 18:13:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Deleting instance files /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b_del
Aug 15 18:13:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Deletion of /opt/stack/data/nova/instances/e315d959-2703-4141-9517-461b29fa492b_del complete
Aug 15 18:13:12 user nova-compute[73007]: INFO nova.compute.manager [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] [instance: e315d959-2703-4141-9517-461b29fa492b] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 18:13:12 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: e315d959-2703-4141-9517-461b29fa492b] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:13:12 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: e315d959-2703-4141-9517-461b29fa492b] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:13:13 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:13:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-be18eaba-3958-4acf-9086-2de772301902 req-86154155-d2fd-4087-bba6-008c9a3ffa09 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-deleted-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:13:13 user nova-compute[73007]: INFO nova.compute.manager [req-be18eaba-3958-4acf-9086-2de772301902 req-86154155-d2fd-4087-bba6-008c9a3ffa09 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Neutron deleted interface dd923fa0-f782-46e9-a52f-5d8042c5a906; detaching it from the instance and deleting it from the info cache
Aug 15 18:13:13 user nova-compute[73007]: DEBUG nova.network.neutron [req-be18eaba-3958-4acf-9086-2de772301902 req-86154155-d2fd-4087-bba6-008c9a3ffa09 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:13:13 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e315d959-2703-4141-9517-461b29fa492b] Took 0.59 seconds to deallocate network for instance.
Aug 15 18:13:13 user nova-compute[73007]: DEBUG nova.compute.manager [req-be18eaba-3958-4acf-9086-2de772301902 req-86154155-d2fd-4087-bba6-008c9a3ffa09 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Detach interface failed, port_id=dd923fa0-f782-46e9-a52f-5d8042c5a906, reason: Instance e315d959-2703-4141-9517-461b29fa492b could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:13:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:13 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:13:13 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:13:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:13 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Deleted allocations for instance e315d959-2703-4141-9517-461b29fa492b
Aug 15 18:13:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-095947ac-f8d2-476c-8a34-5886bb33c1af tempest-TestMinimumBasicScenario-1021033428 tempest-TestMinimumBasicScenario-1021033428-project-member] Lock "e315d959-2703-4141-9517-461b29fa492b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.918s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-ddba30eb-f66a-4b93-907e-75a2034e8061 req-407085b6-2c39-4407-9aca-60f91c67dd06 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:13:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ddba30eb-f66a-4b93-907e-75a2034e8061 req-407085b6-2c39-4407-9aca-60f91c67dd06 service nova] Acquiring lock "e315d959-2703-4141-9517-461b29fa492b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ddba30eb-f66a-4b93-907e-75a2034e8061 req-407085b6-2c39-4407-9aca-60f91c67dd06 service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:14 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-ddba30eb-f66a-4b93-907e-75a2034e8061 req-407085b6-2c39-4407-9aca-60f91c67dd06 service nova] Lock "e315d959-2703-4141-9517-461b29fa492b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:14 user nova-compute[73007]: DEBUG nova.compute.manager [req-ddba30eb-f66a-4b93-907e-75a2034e8061 req-407085b6-2c39-4407-9aca-60f91c67dd06 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] No waiting events found dispatching network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:13:14 user nova-compute[73007]: WARNING nova.compute.manager [req-ddba30eb-f66a-4b93-907e-75a2034e8061 req-407085b6-2c39-4407-9aca-60f91c67dd06 service nova] [instance: e315d959-2703-4141-9517-461b29fa492b] Received unexpected event network-vif-plugged-dd923fa0-f782-46e9-a52f-5d8042c5a906 for instance with vm_state deleted and task_state None.
Aug 15 18:13:17 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGgxOqEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:13:17 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:13:17 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:13:17 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f477dd0-f13e-4d25-a1d1-5734ff7773d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:13:17 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac394cee-14b7-4039-9c3c-526175e77beb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497] added
Aug 15 18:13:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f2c7c2-64e8-41b3-93c0-cc3474094626]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[febc83eb-18af-435c-8079-4600534e9c23]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGgxOqEL {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGgxOqEL" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e181204-56df-4175-863e-3b3d42366847]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGgxOqEL'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb214602-8fe9-47a2-8b25-b24916a3b663]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b6857-7487-44c7-9193-00d03ddae2c9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:13:17 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:13:17 user nova-compute[73007]:  {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:13:17 user nova-compute[73007]: WARNING os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 18:13:17 user nova-compute[73007]: 
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c429e11d-a9e9-42e1-904c-94ae991c912f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497, portal: 172.16.0.220,3260]
Aug 15 18:13:17 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497, portal: 172.16.0.220,3260] successful.
Aug 15 18:13:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf9d4c5-4b30-47de-8943-cbeb8b532bbe]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c40c02d-a296-4c4a-a43f-accd5dca3b4c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 (non-flash)
Aug 15 18:13:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 (non-flash)
Aug 15 18:13:17 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32959d-2f6f-41bd-be48-84587d03f06f]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:13:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGgxOqEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23838643265653130', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838643265653130', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG nova.objects.instance [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lazy-loading 'flavor' on Instance uuid d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:13:18 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:13:18 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:13:18 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:13:18 user nova-compute[73007]:   <serial>26ee8db5-68ff-4325-8193-84c502470497</serial>
Aug 15 18:13:18 user nova-compute[73007]: </disk>
Aug 15 18:13:18 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:13:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] No VIF found with MAC fa:16:3e:b7:01:a9, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:13:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-38d9938e-8acc-40ef-8dd1-93761726cab9 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.169s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:20 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:20 user nova-compute[73007]: INFO nova.compute.manager [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Detaching volume 26ee8db5-68ff-4325-8193-84c502470497
Aug 15 18:13:20 user nova-compute[73007]: INFO nova.virt.block_device [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Attempting to driver detach volume 26ee8db5-68ff-4325-8193-84c502470497 from mountpoint /dev/vdb
Aug 15 18:13:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Attempting to detach device vdb from instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:13:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:13:20 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:13:20 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:13:20 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:13:20 user nova-compute[73007]:   <serial>26ee8db5-68ff-4325-8193-84c502470497</serial>
Aug 15 18:13:20 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:13:20 user nova-compute[73007]: </disk>
Aug 15 18:13:20 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:13:20 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Successfully detached device vdb from instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 from the persistent domain config.
Aug 15 18:13:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:13:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:13:20 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:13:20 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:13:20 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:13:20 user nova-compute[73007]:   <serial>26ee8db5-68ff-4325-8193-84c502470497</serial>
Aug 15 18:13:20 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:13:20 user nova-compute[73007]: </disk>
Aug 15 18:13:20 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692123201.1373048, d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:13:21 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Successfully detached device vdb from instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 from the live domain config.
Aug 15 18:13:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGgxOqEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:13:21 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01dc56d-bf22-423a-a749-90f33c7c7ee0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[289c4659-9112-4719-8513-4b5fe738b26c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 (non-flash)
Aug 15 18:13:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 (non-flash)
Aug 15 18:13:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c79d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[086f5806-e504-4811-a43a-07aabb4abbd5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dc6e9c-b0ce-40b2-9995-59476dfbea5d]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf399e0-3017-4d4d-9217-e806d01c9d67]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2dab6e-222e-45f2-a181-c8318201f8eb]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7479c72-8985-449a-a1e7-0e0c2f70b97b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecc156c-9390-4bd0-b07e-adc7e31e1d8c]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497, portal: 172.16.0.220,3260]
Aug 15 18:13:21 user nova-compute[73007]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497, portal: 172.16.0.220,3260] successful.
Aug 15 18:13:21 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ee8db5-68ff-4325-8193-84c502470497 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[656311da-6725-44d7-bf6d-f9d777cbcfde]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] <== disconnect_volume: return (268ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:13:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:13:22 user nova-compute[73007]: DEBUG nova.objects.instance [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lazy-loading 'flavor' on Instance uuid d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:13:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-2f38aabb-f5ec-48cf-810d-fab634b3cb8a tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.510s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:23 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "abd297b4-0aac-4c37-9b07-927b11a753f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:24 user nova-compute[73007]: INFO nova.compute.manager [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Terminating instance
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-83c91072-b9b3-4b6b-b06a-696736c95fa4 req-ac71c0fa-ba6f-44bb-b5d3-fe662f244c7a service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received event network-vif-unplugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-83c91072-b9b3-4b6b-b06a-696736c95fa4 req-ac71c0fa-ba6f-44bb-b5d3-fe662f244c7a service nova] Acquiring lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-83c91072-b9b3-4b6b-b06a-696736c95fa4 req-ac71c0fa-ba6f-44bb-b5d3-fe662f244c7a service nova] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-83c91072-b9b3-4b6b-b06a-696736c95fa4 req-ac71c0fa-ba6f-44bb-b5d3-fe662f244c7a service nova] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-83c91072-b9b3-4b6b-b06a-696736c95fa4 req-ac71c0fa-ba6f-44bb-b5d3-fe662f244c7a service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] No waiting events found dispatching network-vif-unplugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-83c91072-b9b3-4b6b-b06a-696736c95fa4 req-ac71c0fa-ba6f-44bb-b5d3-fe662f244c7a service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received event network-vif-unplugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:13:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Instance destroyed successfully.
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lazy-loading 'resources' on Instance uuid abd297b4-0aac-4c37-9b07-927b11a753f6 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-316018389',display_name='tempest-VolumesActionsTest-instance-316018389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-316018389',id=50,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66e7f81225b54c3e8881b62c6a62d8fd',ramdisk_id='',reservation_id='r-tgplztjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2015943328',owner_user_name='tempest-VolumesActionsTest-2015943328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:11:25Z,user_data=None,user_id='b9389eded2194f4fb3cf788f2ebddcc3',uuid=abd297b4-0aac-4c37-9b07-927b11a753f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Converting VIF {"id": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "address": "fa:16:3e:f0:e9:31", "network": {"id": "6ba694db-afc3-4222-bb07-8e284c002e14", "bridge": "br-int", "label": "tempest-VolumesActionsTest-736350825-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e7f81225b54c3e8881b62c6a62d8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e2b1e9-9e", "ovs_interfaceid": "74e2b1e9-9e11-4f29-9d1f-0891c233ec5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=74e2b1e9-9e11-4f29-9d1f-0891c233ec5a,network=Network(6ba694db-afc3-4222-bb07-8e284c002e14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e2b1e9-9e') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG os_vif [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=74e2b1e9-9e11-4f29-9d1f-0891c233ec5a,network=Network(6ba694db-afc3-4222-bb07-8e284c002e14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e2b1e9-9e') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74e2b1e9-9e, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:13:24 user nova-compute[73007]: INFO os_vif [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e9:31,bridge_name='br-int',has_traffic_filtering=True,id=74e2b1e9-9e11-4f29-9d1f-0891c233ec5a,network=Network(6ba694db-afc3-4222-bb07-8e284c002e14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e2b1e9-9e')
Aug 15 18:13:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Deleting instance files /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6_del
Aug 15 18:13:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Deletion of /opt/stack/data/nova/instances/abd297b4-0aac-4c37-9b07-927b11a753f6_del complete
Aug 15 18:13:24 user nova-compute[73007]: INFO nova.compute.manager [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 15 18:13:24 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:13:24 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updating instance_info_cache with network_info: [{"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:13:25 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Took 0.58 seconds to deallocate network for instance.
Aug 15 18:13:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-b42a9bb4-1ae0-4892-a6f8-08020aa1de5b req-142a811f-fe92-412b-a871-43fc493a073d service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received event network-vif-deleted-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:13:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:25 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Deleted allocations for instance abd297b4-0aac-4c37-9b07-927b11a753f6
Aug 15 18:13:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-4e301e0f-d97a-43fa-8899-a581d6437b8d tempest-VolumesActionsTest-2015943328 tempest-VolumesActionsTest-2015943328-project-member] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.658s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:26 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-8a6758d1-1709-46e5-94e2-29a4b3b7f8da req-f2e072ae-505e-4f4d-aa16-9f6a23a444ac service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received event network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:13:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8a6758d1-1709-46e5-94e2-29a4b3b7f8da req-f2e072ae-505e-4f4d-aa16-9f6a23a444ac service nova] Acquiring lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8a6758d1-1709-46e5-94e2-29a4b3b7f8da req-f2e072ae-505e-4f4d-aa16-9f6a23a444ac service nova] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-8a6758d1-1709-46e5-94e2-29a4b3b7f8da req-f2e072ae-505e-4f4d-aa16-9f6a23a444ac service nova] Lock "abd297b4-0aac-4c37-9b07-927b11a753f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:26 user nova-compute[73007]: DEBUG nova.compute.manager [req-8a6758d1-1709-46e5-94e2-29a4b3b7f8da req-f2e072ae-505e-4f4d-aa16-9f6a23a444ac service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] No waiting events found dispatching network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:13:26 user nova-compute[73007]: WARNING nova.compute.manager [req-8a6758d1-1709-46e5-94e2-29a4b3b7f8da req-f2e072ae-505e-4f4d-aa16-9f6a23a444ac service nova] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Received unexpected event network-vif-plugged-74e2b1e9-9e11-4f29-9d1f-0891c233ec5a for instance with vm_state deleted and task_state None.
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692123192.5032518, e315d959-2703-4141-9517-461b29fa492b => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:13:27 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: e315d959-2703-4141-9517-461b29fa492b] VM Stopped (Lifecycle Event)
Aug 15 18:13:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-7ed106e4-ec76-411e-a32e-3015c22794be None None] [instance: e315d959-2703-4141-9517-461b29fa492b] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:13:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:13:28 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:13:28 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:13:28 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=25.151119232177734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:13:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:13:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:32 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:13:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:37 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:13:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:39 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692123204.591882, abd297b4-0aac-4c37-9b07-927b11a753f6 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:13:39 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] VM Stopped (Lifecycle Event)
Aug 15 18:13:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-49e983a1-adc5-45bc-9be4-1d01f75bab1e None None] [instance: abd297b4-0aac-4c37-9b07-927b11a753f6] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:13:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:13:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:13:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:13:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:13:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:13:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:13:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:13:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:14:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:14:17 user nova-compute[73007]: INFO nova.compute.manager [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Terminating instance
Aug 15 18:14:17 user nova-compute[73007]: DEBUG nova.compute.manager [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-d42a2272-e807-477d-b0ee-83d120a023cd req-1406a294-9768-4371-b031-e3d48663e50b service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received event network-vif-unplugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d42a2272-e807-477d-b0ee-83d120a023cd req-1406a294-9768-4371-b031-e3d48663e50b service nova] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d42a2272-e807-477d-b0ee-83d120a023cd req-1406a294-9768-4371-b031-e3d48663e50b service nova] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d42a2272-e807-477d-b0ee-83d120a023cd req-1406a294-9768-4371-b031-e3d48663e50b service nova] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-d42a2272-e807-477d-b0ee-83d120a023cd req-1406a294-9768-4371-b031-e3d48663e50b service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] No waiting events found dispatching network-vif-unplugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:14:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-d42a2272-e807-477d-b0ee-83d120a023cd req-1406a294-9768-4371-b031-e3d48663e50b service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received event network-vif-unplugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:14:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Instance destroyed successfully.
Aug 15 18:14:18 user nova-compute[73007]: DEBUG nova.objects.instance [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lazy-loading 'resources' on Instance uuid d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:11:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1867859681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1867859681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1867859',id=49,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISaGJsYmoLxynOO0gnXpDggPCzANQZDUgQ4L3lqRMKMGAx3hIbMc9ZjHekyKIvaV5HXcO3MWWHTa2SLCbvCeAwBtFeMAW35HBvzzInMCy85Fh4DsIh1r8tb5aaxdoHbVQ==',key_name='tempest-keypair-258257796',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3d4c73f1fd43239bb0a8c8ddb0868e',ramdisk_id='',reservation_id='r-v7qnurpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1992269513',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f2549603e934b3390bc22d8d3e6bbfa',uuid=d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Converting VIF {"id": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "address": "fa:16:3e:b7:01:a9", "network": {"id": "8fc75e6f-16be-4448-ac3b-12ef86da7afb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2003276804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3d4c73f1fd43239bb0a8c8ddb0868e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap522613a7-b2", "ovs_interfaceid": "522613a7-b2cf-4f85-b62a-2b4e1ac6da44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=522613a7-b2cf-4f85-b62a-2b4e1ac6da44,network=Network(8fc75e6f-16be-4448-ac3b-12ef86da7afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap522613a7-b2') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG os_vif [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=522613a7-b2cf-4f85-b62a-2b4e1ac6da44,network=Network(8fc75e6f-16be-4448-ac3b-12ef86da7afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap522613a7-b2') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap522613a7-b2, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:14:18 user nova-compute[73007]: INFO os_vif [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:01:a9,bridge_name='br-int',has_traffic_filtering=True,id=522613a7-b2cf-4f85-b62a-2b4e1ac6da44,network=Network(8fc75e6f-16be-4448-ac3b-12ef86da7afb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap522613a7-b2')
Aug 15 18:14:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Deleting instance files /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442_del
Aug 15 18:14:18 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Deletion of /opt/stack/data/nova/instances/d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442_del complete
Aug 15 18:14:18 user nova-compute[73007]: INFO nova.compute.manager [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 18:14:18 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:14:18 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:14:19 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Took 0.99 seconds to deallocate network for instance.
Aug 15 18:14:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:14:19 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Deleted allocations for instance d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442
Aug 15 18:14:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-849075a0-c176-4109-ad1e-2c58ab7af732 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513 tempest-TestServerVolumeAttachScenarioOldVersion-1992269513-project-member] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.211s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-cabf7f05-401e-42cd-bc2a-aa3060b5296a req-6f4e409d-93be-4071-b343-32eaf40c5888 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received event network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cabf7f05-401e-42cd-bc2a-aa3060b5296a req-6f4e409d-93be-4071-b343-32eaf40c5888 service nova] Acquiring lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cabf7f05-401e-42cd-bc2a-aa3060b5296a req-6f4e409d-93be-4071-b343-32eaf40c5888 service nova] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-cabf7f05-401e-42cd-bc2a-aa3060b5296a req-6f4e409d-93be-4071-b343-32eaf40c5888 service nova] Lock "d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:14:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-cabf7f05-401e-42cd-bc2a-aa3060b5296a req-6f4e409d-93be-4071-b343-32eaf40c5888 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] No waiting events found dispatching network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:14:19 user nova-compute[73007]: WARNING nova.compute.manager [req-cabf7f05-401e-42cd-bc2a-aa3060b5296a req-6f4e409d-93be-4071-b343-32eaf40c5888 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received unexpected event network-vif-plugged-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 for instance with vm_state deleted and task_state None.
Aug 15 18:14:19 user nova-compute[73007]: DEBUG nova.compute.manager [req-cabf7f05-401e-42cd-bc2a-aa3060b5296a req-6f4e409d-93be-4071-b343-32eaf40c5888 service nova] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Received event network-vif-deleted-522613a7-b2cf-4f85-b62a-2b4e1ac6da44 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:14:20 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 18:14:20 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 18:14:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:14:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:14:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:26 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:26 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 18:14:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:14:29 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:14:29 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.216442108154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 18:14:29 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 18:14:30 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:14:30 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:14:30 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:14:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:14:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:33 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692123258.372479, d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:14:33 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] VM Stopped (Lifecycle Event)
Aug 15 18:14:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-19aba312-1911-40e5-98ec-36358a06ee08 None None] [instance: d6e2a45b-4e8e-4ed1-87a3-ad92c6de3442] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:14:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:14:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:14:46 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:14:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:14:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:14:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:14:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:14:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:14:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:14:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:14:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:14:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:14:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:14:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:15:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:22 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:15:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:15:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:15:24 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:15:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:15:29 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:15:29 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:15:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.20551300048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:15:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:32 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:34 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:15:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:15:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:15:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:15:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:15:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:15:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "ed104b2c-945c-4e6b-a975-0601d8879168" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "ed104b2c-945c-4e6b-a975-0601d8879168" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:15:50 user nova-compute[73007]: INFO nova.compute.claims [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Claim successful on node user
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.network.neutron [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:15:50 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:15:50 user nova-compute[73007]: DEBUG nova.policy [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4c5a520edc547188b2bc274bc4f7ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f490b15654f3f8660782d44ac439d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:15:51 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Creating image(s)
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "/opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "/opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk 1073741824" returned: 0 in 0.052s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG nova.network.neutron [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Successfully created port: 0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Cannot resize image /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG nova.objects.instance [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lazy-loading 'migration_context' on Instance uuid ed104b2c-945c-4e6b-a975-0601d8879168 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Ensure instance console log exists: /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:51 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Successfully updated port: 0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquired lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-52fa6ccf-87db-475c-9d50-d0573c5edbeb req-d92e713f-e61b-4663-bc1d-e5eb834a2a4f service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received event network-changed-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.compute.manager [req-52fa6ccf-87db-475c-9d50-d0573c5edbeb req-d92e713f-e61b-4663-bc1d-e5eb834a2a4f service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Refreshing instance network info cache due to event network-changed-0d672d56-fcb8-4f11-8896-80c7ea15de9d. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-52fa6ccf-87db-475c-9d50-d0573c5edbeb req-d92e713f-e61b-4663-bc1d-e5eb834a2a4f service nova] Acquiring lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.neutron [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Updating instance_info_cache with network_info: [{"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Releasing lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Instance network_info: |[{"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-52fa6ccf-87db-475c-9d50-d0573c5edbeb req-d92e713f-e61b-4663-bc1d-e5eb834a2a4f service nova] Acquired lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.neutron [req-52fa6ccf-87db-475c-9d50-d0573c5edbeb req-d92e713f-e61b-4663-bc1d-e5eb834a2a4f service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Refreshing network info cache for port 0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Start _get_guest_xml network_info=[{"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:15:52 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:15:52 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1387194880',display_name='tempest-VolumesActionsTest-instance-1387194880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1387194880',id=51,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a52f490b15654f3f8660782d44ac439d',ramdisk_id='',reservation_id='r-do04kxmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-931170964',owner_user_name='tempest-VolumesActionsTest-931170964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:15:51Z,user_data=None,user_id='f4c5a520edc547188b2bc274bc4f7ad2',uuid=ed104b2c-945c-4e6b-a975-0601d8879168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converting VIF {"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:3c:6f,bridge_name='br-int',has_traffic_filtering=True,id=0d672d56-fcb8-4f11-8896-80c7ea15de9d,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d672d56-fc') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.objects.instance [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lazy-loading 'pci_devices' on Instance uuid ed104b2c-945c-4e6b-a975-0601d8879168 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:15:52 user nova-compute[73007]:   <uuid>ed104b2c-945c-4e6b-a975-0601d8879168</uuid>
Aug 15 18:15:52 user nova-compute[73007]:   <name>instance-00000033</name>
Aug 15 18:15:52 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:15:52 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:15:52 user nova-compute[73007]:   <metadata>
Aug 15 18:15:52 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:15:52 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:15:52 user nova-compute[73007]:       <nova:name>tempest-VolumesActionsTest-instance-1387194880</nova:name>
Aug 15 18:15:52 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:15:52</nova:creationTime>
Aug 15 18:15:52 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:15:52 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:15:52 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:15:52 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:15:52 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:15:52 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:15:52 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:15:52 user nova-compute[73007]:       <nova:owner>
Aug 15 18:15:52 user nova-compute[73007]:         <nova:user uuid="f4c5a520edc547188b2bc274bc4f7ad2">tempest-VolumesActionsTest-931170964-project-member</nova:user>
Aug 15 18:15:52 user nova-compute[73007]:         <nova:project uuid="a52f490b15654f3f8660782d44ac439d">tempest-VolumesActionsTest-931170964</nova:project>
Aug 15 18:15:52 user nova-compute[73007]:       </nova:owner>
Aug 15 18:15:52 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:15:52 user nova-compute[73007]:       <nova:ports>
Aug 15 18:15:52 user nova-compute[73007]:         <nova:port uuid="0d672d56-fcb8-4f11-8896-80c7ea15de9d">
Aug 15 18:15:52 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 18:15:52 user nova-compute[73007]:         </nova:port>
Aug 15 18:15:52 user nova-compute[73007]:       </nova:ports>
Aug 15 18:15:52 user nova-compute[73007]:     </nova:instance>
Aug 15 18:15:52 user nova-compute[73007]:   </metadata>
Aug 15 18:15:52 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:15:52 user nova-compute[73007]:     <system>
Aug 15 18:15:52 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:15:52 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:15:52 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:15:52 user nova-compute[73007]:       <entry name="serial">ed104b2c-945c-4e6b-a975-0601d8879168</entry>
Aug 15 18:15:52 user nova-compute[73007]:       <entry name="uuid">ed104b2c-945c-4e6b-a975-0601d8879168</entry>
Aug 15 18:15:52 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:15:52 user nova-compute[73007]:     </system>
Aug 15 18:15:52 user nova-compute[73007]:   </sysinfo>
Aug 15 18:15:52 user nova-compute[73007]:   <os>
Aug 15 18:15:52 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:15:52 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:15:52 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:15:52 user nova-compute[73007]:   </os>
Aug 15 18:15:52 user nova-compute[73007]:   <features>
Aug 15 18:15:52 user nova-compute[73007]:     <acpi/>
Aug 15 18:15:52 user nova-compute[73007]:     <apic/>
Aug 15 18:15:52 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:15:52 user nova-compute[73007]:   </features>
Aug 15 18:15:52 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:15:52 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:15:52 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:15:52 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:15:52 user nova-compute[73007]:   </clock>
Aug 15 18:15:52 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:15:52 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:15:52 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:15:52 user nova-compute[73007]:   </cpu>
Aug 15 18:15:52 user nova-compute[73007]:   <devices>
Aug 15 18:15:52 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:15:52 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:15:52 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk"/>
Aug 15 18:15:52 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:15:52 user nova-compute[73007]:     </disk>
Aug 15 18:15:52 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:15:52 user nova-compute[73007]:       <mac address="fa:16:3e:5e:3c:6f"/>
Aug 15 18:15:52 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:15:52 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:15:52 user nova-compute[73007]:       <target dev="tap0d672d56-fc"/>
Aug 15 18:15:52 user nova-compute[73007]:     </interface>
Aug 15 18:15:52 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:15:52 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/console.log" append="off"/>
Aug 15 18:15:52 user nova-compute[73007]:     </serial>
Aug 15 18:15:52 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:15:52 user nova-compute[73007]:     <video>
Aug 15 18:15:52 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:15:52 user nova-compute[73007]:     </video>
Aug 15 18:15:52 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:15:52 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:15:52 user nova-compute[73007]:     </rng>
Aug 15 18:15:52 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:15:52 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:15:52 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:15:52 user nova-compute[73007]:     </memballoon>
Aug 15 18:15:52 user nova-compute[73007]:   </devices>
Aug 15 18:15:52 user nova-compute[73007]: </domain>
Aug 15 18:15:52 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1387194880',display_name='tempest-VolumesActionsTest-instance-1387194880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1387194880',id=51,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a52f490b15654f3f8660782d44ac439d',ramdisk_id='',reservation_id='r-do04kxmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-931170964',owner_user_name='tempest-VolumesActionsTest-931170964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:15:51Z,user_data=None,user_id='f4c5a520edc547188b2bc274bc4f7ad2',uuid=ed104b2c-945c-4e6b-a975-0601d8879168,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converting VIF {"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:3c:6f,bridge_name='br-int',has_traffic_filtering=True,id=0d672d56-fcb8-4f11-8896-80c7ea15de9d,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d672d56-fc') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG os_vif [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:3c:6f,bridge_name='br-int',has_traffic_filtering=True,id=0d672d56-fcb8-4f11-8896-80c7ea15de9d,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d672d56-fc') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d672d56-fc, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d672d56-fc, col_values=(('external_ids', {'iface-id': '0d672d56-fcb8-4f11-8896-80c7ea15de9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:3c:6f', 'vm-uuid': 'ed104b2c-945c-4e6b-a975-0601d8879168'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:52 user nova-compute[73007]: INFO os_vif [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:3c:6f,bridge_name='br-int',has_traffic_filtering=True,id=0d672d56-fcb8-4f11-8896-80c7ea15de9d,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d672d56-fc')
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:15:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] No VIF found with MAC fa:16:3e:5e:3c:6f, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:15:53 user nova-compute[73007]: DEBUG nova.network.neutron [req-52fa6ccf-87db-475c-9d50-d0573c5edbeb req-d92e713f-e61b-4663-bc1d-e5eb834a2a4f service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Updated VIF entry in instance network info cache for port 0d672d56-fcb8-4f11-8896-80c7ea15de9d. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:15:53 user nova-compute[73007]: DEBUG nova.network.neutron [req-52fa6ccf-87db-475c-9d50-d0573c5edbeb req-d92e713f-e61b-4663-bc1d-e5eb834a2a4f service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Updating instance_info_cache with network_info: [{"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:15:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-52fa6ccf-87db-475c-9d50-d0573c5edbeb req-d92e713f-e61b-4663-bc1d-e5eb834a2a4f service nova] Releasing lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-7ff93746-25e5-4ea7-aa6e-33d609a2af42 req-de526d2c-a4d5-44d1-83ea-44427f1687bd service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received event network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7ff93746-25e5-4ea7-aa6e-33d609a2af42 req-de526d2c-a4d5-44d1-83ea-44427f1687bd service nova] Acquiring lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7ff93746-25e5-4ea7-aa6e-33d609a2af42 req-de526d2c-a4d5-44d1-83ea-44427f1687bd service nova] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-7ff93746-25e5-4ea7-aa6e-33d609a2af42 req-de526d2c-a4d5-44d1-83ea-44427f1687bd service nova] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-7ff93746-25e5-4ea7-aa6e-33d609a2af42 req-de526d2c-a4d5-44d1-83ea-44427f1687bd service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] No waiting events found dispatching network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:15:54 user nova-compute[73007]: WARNING nova.compute.manager [req-7ff93746-25e5-4ea7-aa6e-33d609a2af42 req-de526d2c-a4d5-44d1-83ea-44427f1687bd service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received unexpected event network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d for instance with vm_state building and task_state spawning.
Aug 15 18:15:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123356.3885474, ed104b2c-945c-4e6b-a975-0601d8879168 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:15:56 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] VM Resumed (Lifecycle Event)
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:15:56 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Instance spawned successfully.
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:15:56 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123356.3924632, ed104b2c-945c-4e6b-a975-0601d8879168 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:15:56 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] VM Started (Lifecycle Event)
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0b2d4ed-2458-42c0-8305-8828c1c3ba09 req-416e3172-418e-4157-8068-bc93e71e4d65 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received event network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0b2d4ed-2458-42c0-8305-8828c1c3ba09 req-416e3172-418e-4157-8068-bc93e71e4d65 service nova] Acquiring lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0b2d4ed-2458-42c0-8305-8828c1c3ba09 req-416e3172-418e-4157-8068-bc93e71e4d65 service nova] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d0b2d4ed-2458-42c0-8305-8828c1c3ba09 req-416e3172-418e-4157-8068-bc93e71e4d65 service nova] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-d0b2d4ed-2458-42c0-8305-8828c1c3ba09 req-416e3172-418e-4157-8068-bc93e71e4d65 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] No waiting events found dispatching network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:15:56 user nova-compute[73007]: WARNING nova.compute.manager [req-d0b2d4ed-2458-42c0-8305-8828c1c3ba09 req-416e3172-418e-4157-8068-bc93e71e4d65 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received unexpected event network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d for instance with vm_state building and task_state spawning.
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:15:56 user nova-compute[73007]: INFO nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 15 18:15:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:15:56 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:15:56 user nova-compute[73007]: INFO nova.compute.manager [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Took 6.09 seconds to build instance.
Aug 15 18:15:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-14ba6bc6-b01f-496f-9017-82f1f653753e tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "ed104b2c-945c-4e6b-a975-0601d8879168" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.236s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:15:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:15:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:16:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid ed104b2c-945c-4e6b-a975-0601d8879168 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Updating instance_info_cache with network_info: [{"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:16:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:29 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:16:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:16:31 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:16:31 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:16:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.17530059814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance ed104b2c-945c-4e6b-a975-0601d8879168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:16:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:16:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:16:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:16:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:16:42 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:16:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:16:52 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:16:57 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:02 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:07 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:12 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:17 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:22 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid ed104b2c-945c-4e6b-a975-0601d8879168 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Updating instance_info_cache with network_info: [{"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-ed104b2c-945c-4e6b-a975-0601d8879168" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:17:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:17:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:27 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:29 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:17:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:17:31 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:17:31 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:17:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.174701690673828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance ed104b2c-945c-4e6b-a975-0601d8879168 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:17:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:17:32 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:32 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:36 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:17:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "ed104b2c-945c-4e6b-a975-0601d8879168" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:17:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "ed104b2c-945c-4e6b-a975-0601d8879168" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:17:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:17:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:17:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:17:40 user nova-compute[73007]: INFO nova.compute.manager [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Terminating instance
Aug 15 18:17:40 user nova-compute[73007]: DEBUG nova.compute.manager [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-5de0464d-2cf1-4f21-bb82-609085abd812 req-790e2c94-3b7e-4bf6-98cc-70c489055458 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received event network-vif-unplugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5de0464d-2cf1-4f21-bb82-609085abd812 req-790e2c94-3b7e-4bf6-98cc-70c489055458 service nova] Acquiring lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5de0464d-2cf1-4f21-bb82-609085abd812 req-790e2c94-3b7e-4bf6-98cc-70c489055458 service nova] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-5de0464d-2cf1-4f21-bb82-609085abd812 req-790e2c94-3b7e-4bf6-98cc-70c489055458 service nova] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-5de0464d-2cf1-4f21-bb82-609085abd812 req-790e2c94-3b7e-4bf6-98cc-70c489055458 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] No waiting events found dispatching network-vif-unplugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.compute.manager [req-5de0464d-2cf1-4f21-bb82-609085abd812 req-790e2c94-3b7e-4bf6-98cc-70c489055458 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received event network-vif-unplugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:41 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Instance destroyed successfully.
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.objects.instance [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lazy-loading 'resources' on Instance uuid ed104b2c-945c-4e6b-a975-0601d8879168 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1387194880',display_name='tempest-VolumesActionsTest-instance-1387194880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1387194880',id=51,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a52f490b15654f3f8660782d44ac439d',ramdisk_id='',reservation_id='r-do04kxmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-931170964',owner_user_name='tempest-VolumesActionsTest-931170964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:15:57Z,user_data=None,user_id='f4c5a520edc547188b2bc274bc4f7ad2',uuid=ed104b2c-945c-4e6b-a975-0601d8879168,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converting VIF {"id": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "address": "fa:16:3e:5e:3c:6f", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d672d56-fc", "ovs_interfaceid": "0d672d56-fcb8-4f11-8896-80c7ea15de9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:3c:6f,bridge_name='br-int',has_traffic_filtering=True,id=0d672d56-fcb8-4f11-8896-80c7ea15de9d,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d672d56-fc') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG os_vif [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:3c:6f,bridge_name='br-int',has_traffic_filtering=True,id=0d672d56-fcb8-4f11-8896-80c7ea15de9d,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d672d56-fc') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d672d56-fc, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:41 user nova-compute[73007]: INFO os_vif [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:3c:6f,bridge_name='br-int',has_traffic_filtering=True,id=0d672d56-fcb8-4f11-8896-80c7ea15de9d,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d672d56-fc')
Aug 15 18:17:41 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Deleting instance files /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168_del
Aug 15 18:17:41 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Deletion of /opt/stack/data/nova/instances/ed104b2c-945c-4e6b-a975-0601d8879168_del complete
Aug 15 18:17:41 user nova-compute[73007]: INFO nova.compute.manager [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 18:17:41 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:17:41 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:17:42 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:17:42 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:17:42 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Took 0.49 seconds to deallocate network for instance.
Aug 15 18:17:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:17:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:17:42 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:17:42 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:17:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:17:42 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Deleted allocations for instance ed104b2c-945c-4e6b-a975-0601d8879168
Aug 15 18:17:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-1afa376e-8be2-4a4e-8739-3a486fd56b4f tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "ed104b2c-945c-4e6b-a975-0601d8879168" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.641s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:17:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-54fcf177-2264-45ee-8646-2c3efd1edb1a req-d6e0aa2f-955c-4997-a972-d65fd3283be9 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received event network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:17:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-54fcf177-2264-45ee-8646-2c3efd1edb1a req-d6e0aa2f-955c-4997-a972-d65fd3283be9 service nova] Acquiring lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:17:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-54fcf177-2264-45ee-8646-2c3efd1edb1a req-d6e0aa2f-955c-4997-a972-d65fd3283be9 service nova] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:17:43 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-54fcf177-2264-45ee-8646-2c3efd1edb1a req-d6e0aa2f-955c-4997-a972-d65fd3283be9 service nova] Lock "ed104b2c-945c-4e6b-a975-0601d8879168-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:17:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-54fcf177-2264-45ee-8646-2c3efd1edb1a req-d6e0aa2f-955c-4997-a972-d65fd3283be9 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] No waiting events found dispatching network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:17:43 user nova-compute[73007]: WARNING nova.compute.manager [req-54fcf177-2264-45ee-8646-2c3efd1edb1a req-d6e0aa2f-955c-4997-a972-d65fd3283be9 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received unexpected event network-vif-plugged-0d672d56-fcb8-4f11-8896-80c7ea15de9d for instance with vm_state deleted and task_state None.
Aug 15 18:17:43 user nova-compute[73007]: DEBUG nova.compute.manager [req-54fcf177-2264-45ee-8646-2c3efd1edb1a req-d6e0aa2f-955c-4997-a972-d65fd3283be9 service nova] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Received event network-vif-deleted-0d672d56-fcb8-4f11-8896-80c7ea15de9d {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:17:46 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:56 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692123461.7445273, ed104b2c-945c-4e6b-a975-0601d8879168 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:17:56 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] VM Stopped (Lifecycle Event)
Aug 15 18:17:56 user nova-compute[73007]: DEBUG nova.compute.manager [None req-433e7dbe-99be-451e-8d57-3ef057c4c7ac None None] [instance: ed104b2c-945c-4e6b-a975-0601d8879168] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:17:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:17:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:17:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:17:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:17:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:17:56 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:18:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:18:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:18:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:18:01 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:11 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:18:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:18:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:18:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:18:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:18:21 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:25 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:18:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:18:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:18:26 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:18:29 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:29 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:18:31 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:18:31 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:18:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=25.201881408691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "d607079b-c853-4e84-b85e-9253b79bdaa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:18:32 user nova-compute[73007]: INFO nova.compute.claims [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Claim successful on node user
Aug 15 18:18:32 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:18:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:18:33 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Creating image(s)
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "/opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "/opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "/opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.policy [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4c5a520edc547188b2bc274bc4f7ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52f490b15654f3f8660782d44ac439d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.168s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk 1073741824" returned: 0 in 0.053s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.175s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Cannot resize image /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lazy-loading 'migration_context' on Instance uuid d607079b-c853-4e84-b85e-9253b79bdaa8 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:18:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Ensure instance console log exists: /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Successfully created port: 26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Successfully updated port: 26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquired lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-d145b2b9-8bfa-4c14-923c-22b6120fd98f req-25e493ae-5274-4e98-9637-2d2308df4fc2 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received event network-changed-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG nova.compute.manager [req-d145b2b9-8bfa-4c14-923c-22b6120fd98f req-25e493ae-5274-4e98-9637-2d2308df4fc2 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Refreshing instance network info cache due to event network-changed-26dd96b9-a721-4899-9cef-d4a50dc43dcb. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d145b2b9-8bfa-4c14-923c-22b6120fd98f req-25e493ae-5274-4e98-9637-2d2308df4fc2 service nova] Acquiring lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:18:34 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Updating instance_info_cache with network_info: [{"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Releasing lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Instance network_info: |[{"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d145b2b9-8bfa-4c14-923c-22b6120fd98f req-25e493ae-5274-4e98-9637-2d2308df4fc2 service nova] Acquired lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-d145b2b9-8bfa-4c14-923c-22b6120fd98f req-25e493ae-5274-4e98-9637-2d2308df4fc2 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Refreshing network info cache for port 26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Start _get_guest_xml network_info=[{"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:18:35 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:18:35 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-926964826',display_name='tempest-VolumesActionsTest-instance-926964826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-926964826',id=52,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a52f490b15654f3f8660782d44ac439d',ramdisk_id='',reservation_id='r-5b2wzn5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-931170964',owner_user_name='tempest-VolumesActionsTest-931170964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:18:33Z,user_data=None,user_id='f4c5a520edc547188b2bc274bc4f7ad2',uuid=d607079b-c853-4e84-b85e-9253b79bdaa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converting VIF {"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:5e:6e,bridge_name='br-int',has_traffic_filtering=True,id=26dd96b9-a721-4899-9cef-d4a50dc43dcb,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd96b9-a7') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.objects.instance [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lazy-loading 'pci_devices' on Instance uuid d607079b-c853-4e84-b85e-9253b79bdaa8 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:18:35 user nova-compute[73007]:   <uuid>d607079b-c853-4e84-b85e-9253b79bdaa8</uuid>
Aug 15 18:18:35 user nova-compute[73007]:   <name>instance-00000034</name>
Aug 15 18:18:35 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:18:35 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:18:35 user nova-compute[73007]:   <metadata>
Aug 15 18:18:35 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:18:35 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:18:35 user nova-compute[73007]:       <nova:name>tempest-VolumesActionsTest-instance-926964826</nova:name>
Aug 15 18:18:35 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:18:35</nova:creationTime>
Aug 15 18:18:35 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:18:35 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:18:35 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:18:35 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:18:35 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:18:35 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:18:35 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:18:35 user nova-compute[73007]:       <nova:owner>
Aug 15 18:18:35 user nova-compute[73007]:         <nova:user uuid="f4c5a520edc547188b2bc274bc4f7ad2">tempest-VolumesActionsTest-931170964-project-member</nova:user>
Aug 15 18:18:35 user nova-compute[73007]:         <nova:project uuid="a52f490b15654f3f8660782d44ac439d">tempest-VolumesActionsTest-931170964</nova:project>
Aug 15 18:18:35 user nova-compute[73007]:       </nova:owner>
Aug 15 18:18:35 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:18:35 user nova-compute[73007]:       <nova:ports>
Aug 15 18:18:35 user nova-compute[73007]:         <nova:port uuid="26dd96b9-a721-4899-9cef-d4a50dc43dcb">
Aug 15 18:18:35 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 18:18:35 user nova-compute[73007]:         </nova:port>
Aug 15 18:18:35 user nova-compute[73007]:       </nova:ports>
Aug 15 18:18:35 user nova-compute[73007]:     </nova:instance>
Aug 15 18:18:35 user nova-compute[73007]:   </metadata>
Aug 15 18:18:35 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:18:35 user nova-compute[73007]:     <system>
Aug 15 18:18:35 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:18:35 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:18:35 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:18:35 user nova-compute[73007]:       <entry name="serial">d607079b-c853-4e84-b85e-9253b79bdaa8</entry>
Aug 15 18:18:35 user nova-compute[73007]:       <entry name="uuid">d607079b-c853-4e84-b85e-9253b79bdaa8</entry>
Aug 15 18:18:35 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:18:35 user nova-compute[73007]:     </system>
Aug 15 18:18:35 user nova-compute[73007]:   </sysinfo>
Aug 15 18:18:35 user nova-compute[73007]:   <os>
Aug 15 18:18:35 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:18:35 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:18:35 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:18:35 user nova-compute[73007]:   </os>
Aug 15 18:18:35 user nova-compute[73007]:   <features>
Aug 15 18:18:35 user nova-compute[73007]:     <acpi/>
Aug 15 18:18:35 user nova-compute[73007]:     <apic/>
Aug 15 18:18:35 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:18:35 user nova-compute[73007]:   </features>
Aug 15 18:18:35 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:18:35 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:18:35 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:18:35 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:18:35 user nova-compute[73007]:   </clock>
Aug 15 18:18:35 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:18:35 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:18:35 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:18:35 user nova-compute[73007]:   </cpu>
Aug 15 18:18:35 user nova-compute[73007]:   <devices>
Aug 15 18:18:35 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:18:35 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:18:35 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk"/>
Aug 15 18:18:35 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:18:35 user nova-compute[73007]:     </disk>
Aug 15 18:18:35 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:18:35 user nova-compute[73007]:       <mac address="fa:16:3e:30:5e:6e"/>
Aug 15 18:18:35 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:18:35 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:18:35 user nova-compute[73007]:       <target dev="tap26dd96b9-a7"/>
Aug 15 18:18:35 user nova-compute[73007]:     </interface>
Aug 15 18:18:35 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:18:35 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/console.log" append="off"/>
Aug 15 18:18:35 user nova-compute[73007]:     </serial>
Aug 15 18:18:35 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:18:35 user nova-compute[73007]:     <video>
Aug 15 18:18:35 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:18:35 user nova-compute[73007]:     </video>
Aug 15 18:18:35 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:18:35 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:18:35 user nova-compute[73007]:     </rng>
Aug 15 18:18:35 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:18:35 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:18:35 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:18:35 user nova-compute[73007]:     </memballoon>
Aug 15 18:18:35 user nova-compute[73007]:   </devices>
Aug 15 18:18:35 user nova-compute[73007]: </domain>
Aug 15 18:18:35 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-926964826',display_name='tempest-VolumesActionsTest-instance-926964826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-926964826',id=52,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a52f490b15654f3f8660782d44ac439d',ramdisk_id='',reservation_id='r-5b2wzn5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-931170964',owner_user_name='tempest-VolumesActionsTest-931170964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:18:33Z,user_data=None,user_id='f4c5a520edc547188b2bc274bc4f7ad2',uuid=d607079b-c853-4e84-b85e-9253b79bdaa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converting VIF {"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:5e:6e,bridge_name='br-int',has_traffic_filtering=True,id=26dd96b9-a721-4899-9cef-d4a50dc43dcb,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd96b9-a7') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG os_vif [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:5e:6e,bridge_name='br-int',has_traffic_filtering=True,id=26dd96b9-a721-4899-9cef-d4a50dc43dcb,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd96b9-a7') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26dd96b9-a7, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26dd96b9-a7, col_values=(('external_ids', {'iface-id': '26dd96b9-a721-4899-9cef-d4a50dc43dcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:5e:6e', 'vm-uuid': 'd607079b-c853-4e84-b85e-9253b79bdaa8'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:35 user nova-compute[73007]: INFO os_vif [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:5e:6e,bridge_name='br-int',has_traffic_filtering=True,id=26dd96b9-a721-4899-9cef-d4a50dc43dcb,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd96b9-a7')
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] No VIF found with MAC fa:16:3e:30:5e:6e, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-d145b2b9-8bfa-4c14-923c-22b6120fd98f req-25e493ae-5274-4e98-9637-2d2308df4fc2 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Updated VIF entry in instance network info cache for port 26dd96b9-a721-4899-9cef-d4a50dc43dcb. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG nova.network.neutron [req-d145b2b9-8bfa-4c14-923c-22b6120fd98f req-25e493ae-5274-4e98-9637-2d2308df4fc2 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Updating instance_info_cache with network_info: [{"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:18:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-d145b2b9-8bfa-4c14-923c-22b6120fd98f req-25e493ae-5274-4e98-9637-2d2308df4fc2 service nova] Releasing lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:18:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:36 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-13d255dd-c919-4284-bb26-45932d854edc req-2ed3bc54-ad15-4c41-8817-4d7c296ff562 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received event network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:18:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-13d255dd-c919-4284-bb26-45932d854edc req-2ed3bc54-ad15-4c41-8817-4d7c296ff562 service nova] Acquiring lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-13d255dd-c919-4284-bb26-45932d854edc req-2ed3bc54-ad15-4c41-8817-4d7c296ff562 service nova] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-13d255dd-c919-4284-bb26-45932d854edc req-2ed3bc54-ad15-4c41-8817-4d7c296ff562 service nova] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:36 user nova-compute[73007]: DEBUG nova.compute.manager [req-13d255dd-c919-4284-bb26-45932d854edc req-2ed3bc54-ad15-4c41-8817-4d7c296ff562 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] No waiting events found dispatching network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:18:36 user nova-compute[73007]: WARNING nova.compute.manager [req-13d255dd-c919-4284-bb26-45932d854edc req-2ed3bc54-ad15-4c41-8817-4d7c296ff562 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received unexpected event network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb for instance with vm_state building and task_state spawning.
Aug 15 18:18:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:37 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:18:37 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123518.7904723, d607079b-c853-4e84-b85e-9253b79bdaa8 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:18:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] VM Resumed (Lifecycle Event)
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:18:38 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Instance spawned successfully.
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:18:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123518.7909977, d607079b-c853-4e84-b85e-9253b79bdaa8 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:18:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] VM Started (Lifecycle Event)
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-c38a8d36-924f-484e-9c50-46e06046cde0 req-f2172758-519f-4fb0-8a75-ceb5a4784c70 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received event network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c38a8d36-924f-484e-9c50-46e06046cde0 req-f2172758-519f-4fb0-8a75-ceb5a4784c70 service nova] Acquiring lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c38a8d36-924f-484e-9c50-46e06046cde0 req-f2172758-519f-4fb0-8a75-ceb5a4784c70 service nova] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c38a8d36-924f-484e-9c50-46e06046cde0 req-f2172758-519f-4fb0-8a75-ceb5a4784c70 service nova] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.compute.manager [req-c38a8d36-924f-484e-9c50-46e06046cde0 req-f2172758-519f-4fb0-8a75-ceb5a4784c70 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] No waiting events found dispatching network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:18:38 user nova-compute[73007]: WARNING nova.compute.manager [req-c38a8d36-924f-484e-9c50-46e06046cde0 req-f2172758-519f-4fb0-8a75-ceb5a4784c70 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received unexpected event network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb for instance with vm_state building and task_state spawning.
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:18:38 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:18:38 user nova-compute[73007]: INFO nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 15 18:18:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:18:39 user nova-compute[73007]: INFO nova.compute.manager [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Took 6.35 seconds to build instance.
Aug 15 18:18:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-3693b1f5-2344-4cc6-8748-9e3b835e4327 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.440s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Verify base images {{(pid=73007) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Image id ebea4084-739d-4b93-af7c-d6ebe6897cd3 yields fingerprint 8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 {{(pid=73007) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] image ebea4084-739d-4b93-af7c-d6ebe6897cd3 at (/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5): checking
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] image ebea4084-739d-4b93-af7c-d6ebe6897cd3 at (/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5): image is in use {{(pid=73007) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73007) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] d607079b-c853-4e84-b85e-9253b79bdaa8 is a valid instance name {{(pid=73007) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] d607079b-c853-4e84-b85e-9253b79bdaa8 has a disk file {{(pid=73007) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d607079b-c853-4e84-b85e-9253b79bdaa8 is backed by 8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 {{(pid=73007) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14
Aug 15 18:18:52 user nova-compute[73007]: WARNING nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Active base files: /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Removable base files: /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20 /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902 /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617 /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9 /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148 /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14 /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee9610e96f059daef7232fecafc3bdd5c7fbfb20
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/94b598af4d575bd5d1160f19ba8f0b8552199cdb
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f914e1f9a0edb35035a702439d3166aa7719902
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1d0d00577b56ee716c9dff38b1d0632d398ed617
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b098ee6fb673df576dcc93bf6f0ded1f7d7e835e
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/39de03cc8182c021a3abba01cde969d9291ba9b9
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/085e269c222b44a107b428bccfe5c467648c3148
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fab8611a3cb5d3786d1590edd80984e57ccc6b14
Aug 15 18:18:52 user nova-compute[73007]: INFO nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4184f4b710a1236d0f260b87d1fe448c06f910d4
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Verification complete {{(pid=73007) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Verify swap images {{(pid=73007) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 18:18:52 user nova-compute[73007]: DEBUG nova.virt.libvirt.imagecache [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Verify ephemeral images {{(pid=73007) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 18:18:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:18:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:21 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 18:19:21 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 18:19:24 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:25 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid d607079b-c853-4e84-b85e-9253b79bdaa8 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Updating instance_info_cache with network_info: [{"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-d607079b-c853-4e84-b85e-9253b79bdaa8" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:19:27 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:19:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:19:31 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:19:32 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:19:32 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.172313690185547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance d607079b-c853-4e84-b85e-9253b79bdaa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:19:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:19:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 18:19:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:35 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:36 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:37 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:19:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:45 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:47 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:19:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:19:55 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:00 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:20:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:20:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:20:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:20:00 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:20:05 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:15 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:20 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "d607079b-c853-4e84-b85e-9253b79bdaa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:20:23 user nova-compute[73007]: INFO nova.compute.manager [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Terminating instance
Aug 15 18:20:23 user nova-compute[73007]: DEBUG nova.compute.manager [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-f02007a4-1945-4b66-90d0-43d849af1142 req-5d000d1b-abc8-4f7f-aba3-e313126364c4 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received event network-vif-unplugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f02007a4-1945-4b66-90d0-43d849af1142 req-5d000d1b-abc8-4f7f-aba3-e313126364c4 service nova] Acquiring lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f02007a4-1945-4b66-90d0-43d849af1142 req-5d000d1b-abc8-4f7f-aba3-e313126364c4 service nova] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-f02007a4-1945-4b66-90d0-43d849af1142 req-5d000d1b-abc8-4f7f-aba3-e313126364c4 service nova] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-f02007a4-1945-4b66-90d0-43d849af1142 req-5d000d1b-abc8-4f7f-aba3-e313126364c4 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] No waiting events found dispatching network-vif-unplugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG nova.compute.manager [req-f02007a4-1945-4b66-90d0-43d849af1142 req-5d000d1b-abc8-4f7f-aba3-e313126364c4 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received event network-vif-unplugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Instance destroyed successfully.
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.objects.instance [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lazy-loading 'resources' on Instance uuid d607079b-c853-4e84-b85e-9253b79bdaa8 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-926964826',display_name='tempest-VolumesActionsTest-instance-926964826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-926964826',id=52,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:18:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a52f490b15654f3f8660782d44ac439d',ramdisk_id='',reservation_id='r-5b2wzn5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-931170964',owner_user_name='tempest-VolumesActionsTest-931170964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:18:39Z,user_data=None,user_id='f4c5a520edc547188b2bc274bc4f7ad2',uuid=d607079b-c853-4e84-b85e-9253b79bdaa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converting VIF {"id": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "address": "fa:16:3e:30:5e:6e", "network": {"id": "c95b8825-eaaf-4c64-bbc9-62548c5d5e9f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2067801743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52f490b15654f3f8660782d44ac439d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd96b9-a7", "ovs_interfaceid": "26dd96b9-a721-4899-9cef-d4a50dc43dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:5e:6e,bridge_name='br-int',has_traffic_filtering=True,id=26dd96b9-a721-4899-9cef-d4a50dc43dcb,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd96b9-a7') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG os_vif [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:5e:6e,bridge_name='br-int',has_traffic_filtering=True,id=26dd96b9-a721-4899-9cef-d4a50dc43dcb,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd96b9-a7') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26dd96b9-a7, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:20:24 user nova-compute[73007]: INFO os_vif [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:5e:6e,bridge_name='br-int',has_traffic_filtering=True,id=26dd96b9-a721-4899-9cef-d4a50dc43dcb,network=Network(c95b8825-eaaf-4c64-bbc9-62548c5d5e9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd96b9-a7')
Aug 15 18:20:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Deleting instance files /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8_del
Aug 15 18:20:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Deletion of /opt/stack/data/nova/instances/d607079b-c853-4e84-b85e-9253b79bdaa8_del complete
Aug 15 18:20:24 user nova-compute[73007]: INFO nova.compute.manager [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 18:20:24 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:20:24 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Took 0.52 seconds to deallocate network for instance.
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-7fa5b51e-dc2e-4cce-a0bf-633c04025c1c req-95ad5192-e132-46e4-a44e-16466338438b service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received event network-vif-deleted-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:20:24 user nova-compute[73007]: INFO nova.compute.manager [req-7fa5b51e-dc2e-4cce-a0bf-633c04025c1c req-95ad5192-e132-46e4-a44e-16466338438b service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Neutron deleted interface 26dd96b9-a721-4899-9cef-d4a50dc43dcb; detaching it from the instance and deleting it from the info cache
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.network.neutron [req-7fa5b51e-dc2e-4cce-a0bf-633c04025c1c req-95ad5192-e132-46e4-a44e-16466338438b service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.compute.manager [req-7fa5b51e-dc2e-4cce-a0bf-633c04025c1c req-95ad5192-e132-46e4-a44e-16466338438b service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Detach interface failed, port_id=26dd96b9-a721-4899-9cef-d4a50dc43dcb, reason: Instance d607079b-c853-4e84-b85e-9253b79bdaa8 could not be found. {{(pid=73007) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:20:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:20:24 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Deleted allocations for instance d607079b-c853-4e84-b85e-9253b79bdaa8
Aug 15 18:20:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-71fa4fce-690b-4cd8-ab42-0143171cb043 tempest-VolumesActionsTest-931170964 tempest-VolumesActionsTest-931170964-project-member] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.783s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:20:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-fa819b34-3688-4408-bf21-7b0b3ca2fae1 req-3f3f9736-33be-4ce1-bdb9-4faf8af501f1 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received event network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:20:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fa819b34-3688-4408-bf21-7b0b3ca2fae1 req-3f3f9736-33be-4ce1-bdb9-4faf8af501f1 service nova] Acquiring lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:20:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fa819b34-3688-4408-bf21-7b0b3ca2fae1 req-3f3f9736-33be-4ce1-bdb9-4faf8af501f1 service nova] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:20:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-fa819b34-3688-4408-bf21-7b0b3ca2fae1 req-3f3f9736-33be-4ce1-bdb9-4faf8af501f1 service nova] Lock "d607079b-c853-4e84-b85e-9253b79bdaa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:20:25 user nova-compute[73007]: DEBUG nova.compute.manager [req-fa819b34-3688-4408-bf21-7b0b3ca2fae1 req-3f3f9736-33be-4ce1-bdb9-4faf8af501f1 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] No waiting events found dispatching network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:20:25 user nova-compute[73007]: WARNING nova.compute.manager [req-fa819b34-3688-4408-bf21-7b0b3ca2fae1 req-3f3f9736-33be-4ce1-bdb9-4faf8af501f1 service nova] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Received unexpected event network-vif-plugged-26dd96b9-a721-4899-9cef-d4a50dc43dcb for instance with vm_state deleted and task_state None.
Aug 15 18:20:26 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:29 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:20:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:20:29 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:20:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:20:32 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:20:32 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:20:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.199501037597656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:20:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:20:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:20:38 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:20:39 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692123624.0115652, d607079b-c853-4e84-b85e-9253b79bdaa8 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:20:39 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] VM Stopped (Lifecycle Event)
Aug 15 18:20:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-60e0f8f7-f41f-4e7f-8aee-86e72711f228 None None] [instance: d607079b-c853-4e84-b85e-9253b79bdaa8] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:20:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:20:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:20:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:20:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:20:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:20:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:20:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:20:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:20:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:20:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:21:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:21:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:21:27 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:21:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:21:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:21:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:21:32 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:21:32 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:21:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=24.739822387695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:21:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:21:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:21:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:21:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:21:48 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:21:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:50 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:21:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:22:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:22:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:22:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:22:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:22:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:22:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:22:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:22:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:22:33 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:22:33 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:22:33 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=25.189029693603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:22:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:22:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:22:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:36 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:39 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:40 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:22:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:22:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:22:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:22:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:23:06 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:10 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:16 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Starting instance... {{(pid=73007) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73007) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 18:23:25 user nova-compute[73007]: INFO nova.compute.claims [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Claim successful on node user
Aug 15 18:23:25 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Start building networks asynchronously for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Allocating IP information in the background. {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 18:23:25 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] allocate_for_instance() {{(pid=73007) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 18:23:25 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 18:23:25 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Start building block device mappings for instance. {{(pid=73007) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG nova.policy [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a62d668a06574a56a6d50fbeed314a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f684adf0d3d4647abbad2d3323b6e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73007) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Start spawning the instance on the hypervisor. {{(pid=73007) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Creating instance directory {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 18:23:26 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Creating image(s)
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "/opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "/opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "/opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.217s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk 1073741824 {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5,backing_fmt=raw /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk 1073741824" returned: 0 in 0.057s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e7ef9dbfbb35d8c5340e934a3a7ea211216b8d5 --force-share --output=json" returned: 0 in 0.205s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk. size=1073741824 {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:23:26 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Successfully created port: 3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 18:23:27 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:23:27 user nova-compute[73007]: DEBUG nova.virt.disk.api [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Cannot resize image /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk to a smaller size. {{(pid=73007) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 18:23:27 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'migration_context' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:23:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Created local disks {{(pid=73007) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 18:23:27 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Ensure instance console log exists: /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/console.log {{(pid=73007) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 18:23:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:27 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Successfully updated port: 3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Building network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Instance cache missing network info. {{(pid=73007) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.network.neutron [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Instance network_info: |[{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73007) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Start _get_guest_xml network_info=[{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'encryption_format': None, 'image_id': 'ebea4084-739d-4b93-af7c-d6ebe6897cd3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 18:23:28 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:23:28 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] CPU controller missing on host. {{(pid=73007) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.host [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] CPU controller found on host. {{(pid=73007) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73007) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T17:39:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T17:39:20Z,direct_url=<?>,disk_format='qcow2',id=ebea4084-739d-4b93-af7c-d6ebe6897cd3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d8b94772033b4529b2f86709fac0a483',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T17:39:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Flavor limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Image limits 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Flavor pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Image pref 0:0:0 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Got 1 possible topologies {{(pid=73007) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.hardware [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73007) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-169455221',display_name='tempest-SnapshotDataIntegrityTests-server-169455221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-169455221',id=53,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkB6UWD7+gBrZETOOKKoDPtUhdla4bYVjIIOOurNwdDG6BOwup8RNogp0cOdqZ3U61y0qIJskImGcKL1PLL88cnEGPb3zNTxyc+bA1gxUbuqnRRFTIKEYsLHxC4W3/Tzw==',key_name='tempest-keypair-575523738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f684adf0d3d4647abbad2d3323b6e77',ramdisk_id='',reservation_id='r-tt4u1pry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-878809701',owner_user_name='tempest-SnapshotDataIntegrityTests-878809701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62d668a06574a56a6d50fbeed314a04',uuid=db082eb4-3e62-4560-b11a-4bd412c7d016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73007) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Converting VIF {"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:29:76,bridge_name='br-int',has_traffic_filtering=True,id=3fb9d2a0-2bb3-4dce-be6d-a168fa346b29,network=Network(617ca2de-53ec-4800-b212-19cbc09427b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb9d2a0-2b') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.objects.instance [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'pci_devices' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] End _get_guest_xml xml=<domain type="kvm">
Aug 15 18:23:28 user nova-compute[73007]:   <uuid>db082eb4-3e62-4560-b11a-4bd412c7d016</uuid>
Aug 15 18:23:28 user nova-compute[73007]:   <name>instance-00000035</name>
Aug 15 18:23:28 user nova-compute[73007]:   <memory>524288</memory>
Aug 15 18:23:28 user nova-compute[73007]:   <vcpu>1</vcpu>
Aug 15 18:23:28 user nova-compute[73007]:   <metadata>
Aug 15 18:23:28 user nova-compute[73007]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 18:23:28 user nova-compute[73007]:       <nova:package version="0.0.0"/>
Aug 15 18:23:28 user nova-compute[73007]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-169455221</nova:name>
Aug 15 18:23:28 user nova-compute[73007]:       <nova:creationTime>2023-08-15 18:23:28</nova:creationTime>
Aug 15 18:23:28 user nova-compute[73007]:       <nova:flavor name="m1.tiny">
Aug 15 18:23:28 user nova-compute[73007]:         <nova:memory>512</nova:memory>
Aug 15 18:23:28 user nova-compute[73007]:         <nova:disk>1</nova:disk>
Aug 15 18:23:28 user nova-compute[73007]:         <nova:swap>0</nova:swap>
Aug 15 18:23:28 user nova-compute[73007]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 18:23:28 user nova-compute[73007]:         <nova:vcpus>1</nova:vcpus>
Aug 15 18:23:28 user nova-compute[73007]:       </nova:flavor>
Aug 15 18:23:28 user nova-compute[73007]:       <nova:owner>
Aug 15 18:23:28 user nova-compute[73007]:         <nova:user uuid="a62d668a06574a56a6d50fbeed314a04">tempest-SnapshotDataIntegrityTests-878809701-project-member</nova:user>
Aug 15 18:23:28 user nova-compute[73007]:         <nova:project uuid="6f684adf0d3d4647abbad2d3323b6e77">tempest-SnapshotDataIntegrityTests-878809701</nova:project>
Aug 15 18:23:28 user nova-compute[73007]:       </nova:owner>
Aug 15 18:23:28 user nova-compute[73007]:       <nova:root type="image" uuid="ebea4084-739d-4b93-af7c-d6ebe6897cd3"/>
Aug 15 18:23:28 user nova-compute[73007]:       <nova:ports>
Aug 15 18:23:28 user nova-compute[73007]:         <nova:port uuid="3fb9d2a0-2bb3-4dce-be6d-a168fa346b29">
Aug 15 18:23:28 user nova-compute[73007]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 18:23:28 user nova-compute[73007]:         </nova:port>
Aug 15 18:23:28 user nova-compute[73007]:       </nova:ports>
Aug 15 18:23:28 user nova-compute[73007]:     </nova:instance>
Aug 15 18:23:28 user nova-compute[73007]:   </metadata>
Aug 15 18:23:28 user nova-compute[73007]:   <sysinfo type="smbios">
Aug 15 18:23:28 user nova-compute[73007]:     <system>
Aug 15 18:23:28 user nova-compute[73007]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 18:23:28 user nova-compute[73007]:       <entry name="product">OpenStack Nova</entry>
Aug 15 18:23:28 user nova-compute[73007]:       <entry name="version">0.0.0</entry>
Aug 15 18:23:28 user nova-compute[73007]:       <entry name="serial">db082eb4-3e62-4560-b11a-4bd412c7d016</entry>
Aug 15 18:23:28 user nova-compute[73007]:       <entry name="uuid">db082eb4-3e62-4560-b11a-4bd412c7d016</entry>
Aug 15 18:23:28 user nova-compute[73007]:       <entry name="family">Virtual Machine</entry>
Aug 15 18:23:28 user nova-compute[73007]:     </system>
Aug 15 18:23:28 user nova-compute[73007]:   </sysinfo>
Aug 15 18:23:28 user nova-compute[73007]:   <os>
Aug 15 18:23:28 user nova-compute[73007]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 18:23:28 user nova-compute[73007]:     <boot dev="hd"/>
Aug 15 18:23:28 user nova-compute[73007]:     <smbios mode="sysinfo"/>
Aug 15 18:23:28 user nova-compute[73007]:   </os>
Aug 15 18:23:28 user nova-compute[73007]:   <features>
Aug 15 18:23:28 user nova-compute[73007]:     <acpi/>
Aug 15 18:23:28 user nova-compute[73007]:     <apic/>
Aug 15 18:23:28 user nova-compute[73007]:     <vmcoreinfo/>
Aug 15 18:23:28 user nova-compute[73007]:   </features>
Aug 15 18:23:28 user nova-compute[73007]:   <clock offset="utc">
Aug 15 18:23:28 user nova-compute[73007]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 18:23:28 user nova-compute[73007]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 18:23:28 user nova-compute[73007]:     <timer name="hpet" present="no"/>
Aug 15 18:23:28 user nova-compute[73007]:   </clock>
Aug 15 18:23:28 user nova-compute[73007]:   <cpu mode="custom" match="exact">
Aug 15 18:23:28 user nova-compute[73007]:     <model>Nehalem</model>
Aug 15 18:23:28 user nova-compute[73007]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 18:23:28 user nova-compute[73007]:   </cpu>
Aug 15 18:23:28 user nova-compute[73007]:   <devices>
Aug 15 18:23:28 user nova-compute[73007]:     <disk type="file" device="disk">
Aug 15 18:23:28 user nova-compute[73007]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 18:23:28 user nova-compute[73007]:       <source file="/opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk"/>
Aug 15 18:23:28 user nova-compute[73007]:       <target dev="vda" bus="virtio"/>
Aug 15 18:23:28 user nova-compute[73007]:     </disk>
Aug 15 18:23:28 user nova-compute[73007]:     <interface type="ethernet">
Aug 15 18:23:28 user nova-compute[73007]:       <mac address="fa:16:3e:b2:29:76"/>
Aug 15 18:23:28 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:23:28 user nova-compute[73007]:       <mtu size="1442"/>
Aug 15 18:23:28 user nova-compute[73007]:       <target dev="tap3fb9d2a0-2b"/>
Aug 15 18:23:28 user nova-compute[73007]:     </interface>
Aug 15 18:23:28 user nova-compute[73007]:     <serial type="pty">
Aug 15 18:23:28 user nova-compute[73007]:       <log file="/opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/console.log" append="off"/>
Aug 15 18:23:28 user nova-compute[73007]:     </serial>
Aug 15 18:23:28 user nova-compute[73007]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 18:23:28 user nova-compute[73007]:     <video>
Aug 15 18:23:28 user nova-compute[73007]:       <model type="virtio"/>
Aug 15 18:23:28 user nova-compute[73007]:     </video>
Aug 15 18:23:28 user nova-compute[73007]:     <rng model="virtio">
Aug 15 18:23:28 user nova-compute[73007]:       <backend model="random">/dev/urandom</backend>
Aug 15 18:23:28 user nova-compute[73007]:     </rng>
Aug 15 18:23:28 user nova-compute[73007]:     <controller type="usb" index="0" model="none"/>
Aug 15 18:23:28 user nova-compute[73007]:     <memballoon model="virtio">
Aug 15 18:23:28 user nova-compute[73007]:       <stats period="10"/>
Aug 15 18:23:28 user nova-compute[73007]:     </memballoon>
Aug 15 18:23:28 user nova-compute[73007]:   </devices>
Aug 15 18:23:28 user nova-compute[73007]: </domain>
Aug 15 18:23:28 user nova-compute[73007]:  {{(pid=73007) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-169455221',display_name='tempest-SnapshotDataIntegrityTests-server-169455221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-169455221',id=53,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkB6UWD7+gBrZETOOKKoDPtUhdla4bYVjIIOOurNwdDG6BOwup8RNogp0cOdqZ3U61y0qIJskImGcKL1PLL88cnEGPb3zNTxyc+bA1gxUbuqnRRFTIKEYsLHxC4W3/Tzw==',key_name='tempest-keypair-575523738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f684adf0d3d4647abbad2d3323b6e77',ramdisk_id='',reservation_id='r-tt4u1pry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-878809701',owner_user_name='tempest-SnapshotDataIntegrityTests-878809701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T18:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62d668a06574a56a6d50fbeed314a04',uuid=db082eb4-3e62-4560-b11a-4bd412c7d016,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Converting VIF {"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:29:76,bridge_name='br-int',has_traffic_filtering=True,id=3fb9d2a0-2bb3-4dce-be6d-a168fa346b29,network=Network(617ca2de-53ec-4800-b212-19cbc09427b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb9d2a0-2b') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG os_vif [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:29:76,bridge_name='br-int',has_traffic_filtering=True,id=3fb9d2a0-2bb3-4dce-be6d-a168fa346b29,network=Network(617ca2de-53ec-4800-b212-19cbc09427b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb9d2a0-2b') {{(pid=73007) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fb9d2a0-2b, may_exist=True, interface_attrs={}) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fb9d2a0-2b, col_values=(('external_ids', {'iface-id': '3fb9d2a0-2bb3-4dce-be6d-a168fa346b29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:29:76', 'vm-uuid': 'db082eb4-3e62-4560-b11a-4bd412c7d016'}),), if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:23:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:28 user nova-compute[73007]: INFO os_vif [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:29:76,bridge_name='br-int',has_traffic_filtering=True,id=3fb9d2a0-2bb3-4dce-be6d-a168fa346b29,network=Network(617ca2de-53ec-4800-b212-19cbc09427b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb9d2a0-2b')
Aug 15 18:23:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:23:29 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No VIF found with MAC fa:16:3e:b2:29:76, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:23:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-c178fccd-b0f7-429f-9840-f7b30f390c38 req-167a1539-d11c-419a-88a3-60ccebc772f7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received event network-changed-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:23:29 user nova-compute[73007]: DEBUG nova.compute.manager [req-c178fccd-b0f7-429f-9840-f7b30f390c38 req-167a1539-d11c-419a-88a3-60ccebc772f7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Refreshing instance network info cache due to event network-changed-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:23:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c178fccd-b0f7-429f-9840-f7b30f390c38 req-167a1539-d11c-419a-88a3-60ccebc772f7 service nova] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:23:29 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c178fccd-b0f7-429f-9840-f7b30f390c38 req-167a1539-d11c-419a-88a3-60ccebc772f7 service nova] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:23:29 user nova-compute[73007]: DEBUG nova.network.neutron [req-c178fccd-b0f7-429f-9840-f7b30f390c38 req-167a1539-d11c-419a-88a3-60ccebc772f7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Refreshing network info cache for port 3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:23:30 user nova-compute[73007]: DEBUG nova.network.neutron [req-c178fccd-b0f7-429f-9840-f7b30f390c38 req-167a1539-d11c-419a-88a3-60ccebc772f7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated VIF entry in instance network info cache for port 3fb9d2a0-2bb3-4dce-be6d-a168fa346b29. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:23:30 user nova-compute[73007]: DEBUG nova.network.neutron [req-c178fccd-b0f7-429f-9840-f7b30f390c38 req-167a1539-d11c-419a-88a3-60ccebc772f7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:23:30 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-c178fccd-b0f7-429f-9840-f7b30f390c38 req-167a1539-d11c-419a-88a3-60ccebc772f7 service nova] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:23:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:30 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Skipping network cache update for instance because it is Building. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received event network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] No waiting events found dispatching network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:23:31 user nova-compute[73007]: WARNING nova.compute.manager [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received unexpected event network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 for instance with vm_state building and task_state spawning.
Aug 15 18:23:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received event network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:31 user nova-compute[73007]: DEBUG nova.compute.manager [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] No waiting events found dispatching network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:23:31 user nova-compute[73007]: WARNING nova.compute.manager [req-0f70e1b6-3727-45cd-a443-d2e58319414c req-9ebc0b98-07d5-4521-b503-5ec2ffb275f6 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received unexpected event network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 for instance with vm_state building and task_state spawning.
Aug 15 18:23:32 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123812.97228, db082eb4-3e62-4560-b11a-4bd412c7d016 => Resumed> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:23:32 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] VM Resumed (Lifecycle Event)
Aug 15 18:23:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Instance event wait completed in 0 seconds for  {{(pid=73007) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 18:23:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Guest created on hypervisor {{(pid=73007) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 18:23:32 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Instance spawned successfully.
Aug 15 18:23:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 18:23:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Found default for hw_cdrom_bus of ide {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Found default for hw_disk_bus of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Found default for hw_input_bus of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Found default for hw_pointer_model of None {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Found default for hw_video_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Found default for hw_vif_model of virtio {{(pid=73007) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 18:23:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.virt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Emitting event <LifecycleEvent: 1692123812.9751768, db082eb4-3e62-4560-b11a-4bd412c7d016 => Started> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:23:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] VM Started (Lifecycle Event)
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73007) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 18:23:33 user nova-compute[73007]: INFO nova.compute.manager [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 18:23:33 user nova-compute[73007]: INFO nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:23:33 user nova-compute[73007]: INFO nova.compute.manager [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Took 7.75 seconds to build instance.
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-8a31e237-9f65-491f-a6e2-b80a2ee63d42 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.882s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:33 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:34 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:23:34 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:23:34 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8550MB free_disk=25.181774139404297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance db082eb4-3e62-4560-b11a-4bd412c7d016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:23:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:23:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:37 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:37 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:41 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:23:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:49 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:23:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:23:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:24:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:24:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:24:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:24:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:28 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 18:24:28 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 18:24:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:24:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:24:34 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:24:35 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:24:35 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=25.136917114257812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance db082eb4-3e62-4560-b11a-4bd412c7d016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:24:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:24:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:39 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:39 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:39 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:39 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 18:24:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:43 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:24:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:24:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:24:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:24:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:24:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:24:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:03 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:25:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:25:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:25:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:25:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:25:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:25:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:25:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:25:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:25:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:25:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:25:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:25:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-62c0e4c8-8f49-4839-86a3-0cf9057aea5c req-9fd9475b-cc16-4ed7-abe5-b61763e78926 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received event network-changed-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:25:17 user nova-compute[73007]: DEBUG nova.compute.manager [req-62c0e4c8-8f49-4839-86a3-0cf9057aea5c req-9fd9475b-cc16-4ed7-abe5-b61763e78926 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Refreshing instance network info cache due to event network-changed-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29. {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 18:25:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-62c0e4c8-8f49-4839-86a3-0cf9057aea5c req-9fd9475b-cc16-4ed7-abe5-b61763e78926 service nova] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:25:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-62c0e4c8-8f49-4839-86a3-0cf9057aea5c req-9fd9475b-cc16-4ed7-abe5-b61763e78926 service nova] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:25:17 user nova-compute[73007]: DEBUG nova.network.neutron [req-62c0e4c8-8f49-4839-86a3-0cf9057aea5c req-9fd9475b-cc16-4ed7-abe5-b61763e78926 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Refreshing network info cache for port 3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 18:25:17 user nova-compute[73007]: DEBUG nova.network.neutron [req-62c0e4c8-8f49-4839-86a3-0cf9057aea5c req-9fd9475b-cc16-4ed7-abe5-b61763e78926 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated VIF entry in instance network info cache for port 3fb9d2a0-2bb3-4dce-be6d-a168fa346b29. {{(pid=73007) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 18:25:17 user nova-compute[73007]: DEBUG nova.network.neutron [req-62c0e4c8-8f49-4839-86a3-0cf9057aea5c req-9fd9475b-cc16-4ed7-abe5-b61763e78926 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:25:17 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-62c0e4c8-8f49-4839-86a3-0cf9057aea5c req-9fd9475b-cc16-4ed7-abe5-b61763e78926 service nova] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:25:18 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:25:21 user nova-compute[73007]: INFO nova.compute.manager [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attaching volume daf424d9-8a9a-42dc-b296-33931832d1c8 to /dev/vdb
Aug 15 18:25:21 user nova-compute[73007]: DEBUG os_brick.utils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ed366-eb85-430a-b6a9-14f69aec659e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f82051-6b5a-4c25-b418-8059c8f56beb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b819bfcb-1b50-4054-b64e-00cc820885b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b917a173-f161-475e-90d1-fb2f180558e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:25:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:25:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:22 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:25:22 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:25:22 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3e6a9-2ae1-4c6a-9f63-9b013c04e7cb]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:25:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:25:22 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:25:22 user nova-compute[73007]: DEBUG os_brick.utils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:25:22 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating existing volume attachment record: ddc7fc12-e1a4-45ea-812d-fb05d09fc3d8 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:25:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkWFLtlf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:25:30 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:25:30 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:25:30 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67874e9-c593-4d3a-a40d-8ba5f8d2b81c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:25:30 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff36dcb-166e-4f0f-a678-6277fa3c31e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8] added
Aug 15 18:25:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99a8acd-96d4-457d-9f0e-052ddad9e792]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8f56f9-62ea-4e2c-ae7f-09bec85c6307]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkWFLtlf {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkWFLtlf" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e03d476-1baa-4c5c-ab92-d288b29a4bf7]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qkWFLtlf'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4066d46-bcee-461b-bd60-351a13f5b130]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c990da71-07ff-48ca-8d71-406e0692ac7d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:25:30 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:25:30 user nova-compute[73007]:  {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:25:30 user nova-compute[73007]: WARNING os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 18:25:30 user nova-compute[73007]: 
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[76324d92-dfbc-4f76-9c25-3106b04cc301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8, portal: 172.16.0.220,3260]
Aug 15 18:25:30 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8, portal: 172.16.0.220,3260] successful.
Aug 15 18:25:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1846b64e-3aa4-4095-af24-ac3e2fa463bb]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2558556b-63b3-47f5-a18d-31857e916882]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 (non-flash)
Aug 15 18:25:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 (non-flash)
Aug 15 18:25:30 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b245d-08d8-46d0-b71d-84664e6584e2]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:25:30 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkWFLtlf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23939643732366562', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939643732366562', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.objects.instance [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:25:31 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:25:31 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:25:31 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:25:31 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:25:31 user nova-compute[73007]:   <serial>daf424d9-8a9a-42dc-b296-33931832d1c8</serial>
Aug 15 18:25:31 user nova-compute[73007]: </disk>
Aug 15 18:25:31 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:25:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:25:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:25:32 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No VIF found with MAC fa:16:3e:b2:29:76, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:25:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-5e6f71d9-d3dc-4e31-8a55-64c9e650117e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.528s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:25:33 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:36 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73007) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 18:25:37 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:25:37 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:25:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.135433197021484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance db082eb4-3e62-4560-b11a-4bd412c7d016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:25:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:25:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:38 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:39 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:43 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:45 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:25:48 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:53 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:25:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:25:58 user nova-compute[73007]: INFO nova.compute.manager [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Detaching volume daf424d9-8a9a-42dc-b296-33931832d1c8
Aug 15 18:25:58 user nova-compute[73007]: INFO nova.virt.block_device [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attempting to driver detach volume daf424d9-8a9a-42dc-b296-33931832d1c8 from mountpoint /dev/vdb
Aug 15 18:25:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Attempting to detach device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:25:58 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:25:58 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:25:58 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:25:58 user nova-compute[73007]:   <serial>daf424d9-8a9a-42dc-b296-33931832d1c8</serial>
Aug 15 18:25:58 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:25:58 user nova-compute[73007]: </disk>
Aug 15 18:25:58 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:25:58 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully detached device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the persistent domain config.
Aug 15 18:25:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:25:58 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:25:58 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:25:58 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:25:58 user nova-compute[73007]:   <serial>daf424d9-8a9a-42dc-b296-33931832d1c8</serial>
Aug 15 18:25:58 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:25:58 user nova-compute[73007]: </disk>
Aug 15 18:25:58 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692123958.6211135, db082eb4-3e62-4560-b11a-4bd412c7d016 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:25:58 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully detached device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the live domain config.
Aug 15 18:25:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkWFLtlf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:25:58 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d30aa9-fb1c-492e-89c4-481d62414dc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd16e97-734e-4f1b-9f5b-7648a231ac79]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 (non-flash)
Aug 15 18:25:58 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 (non-flash)
Aug 15 18:25:58 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c4f6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f337b2-6396-490f-8031-2c61fc1e8dbb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff5b8c6-54de-4f51-a784-7500df81d251]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[e283b49a-6874-47f9-bd24-1b05584d73ba]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa88261-a253-4130-ad37-759a47508145]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[756a9b20-b57c-4e28-b5d2-189bc051c3e6]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d9ac51-1992-4e75-bca8-2a9db93dbf30]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8, portal: 172.16.0.220,3260]
Aug 15 18:25:58 user nova-compute[73007]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8, portal: 172.16.0.220,3260] successful.
Aug 15 18:25:58 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf424d9-8a9a-42dc-b296-33931832d1c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd1ed14-0203-4815-8ffc-ec773703e741]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== disconnect_volume: return (307ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:25:58 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:25:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:25:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:25:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:25:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:25:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:25:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:25:59 user nova-compute[73007]: DEBUG nova.objects.instance [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:25:59 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-219a2d9b-9ddf-4abe-960a-b7c606653dc8 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.602s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:26:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:26:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:26:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:26:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:26:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:26:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:26:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:26:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:26:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:26:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:26:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:26:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:26:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:26:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:26:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:26:31 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:26:36 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:26:37 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:26:37 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:26:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.134563446044922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance db082eb4-3e62-4560-b11a-4bd412c7d016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:26:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:26:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:42 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:26:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:26:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:26:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:26:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:45 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:26:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:26:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG nova.objects.instance [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:26:52 user nova-compute[73007]: INFO nova.compute.manager [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attaching volume 6b04faa5-040d-45f5-ad74-269fb4b1c4d7 to /dev/vdb
Aug 15 18:26:52 user nova-compute[73007]: DEBUG os_brick.utils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[922b5825-07c3-4a98-b13e-ef7a35360f0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e654c4-6d40-4d20-aa3e-2c618dfe81ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fee8ff5-5c91-4b06-819d-de34fdac458f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3c4bd-98c4-4df4-afa2-80271ae54e0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:26:52 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:26:52 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704dc36-a0fe-4221-abf1-6a6448efde27]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG os_brick.utils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:26:52 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating existing volume attachment record: 9c1c69df-bee1-44f3-997b-b8e66d519f2c {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:26:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:26:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAUdxrwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:27:00 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:27:00 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:27:00 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a29620a-b282-4343-8a95-4a99204447c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:27:00 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e80ac-36a2-43df-82a7-fc6be7ea4127]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7] added
Aug 15 18:27:00 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae2f85-05e4-45db-bd58-ce095c549c68]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5e9517-ea67-413b-98ee-9ee02263e5b5]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:00 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAUdxrwe {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAUdxrwe" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee239e-a5a1-44a2-a2a6-354d3d7e1099]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TAUdxrwe'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3594a-cf9c-4940-b33f-39d284bd9850]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a4202-466e-474c-a36f-4517a6ef11d9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:27:01 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:27:01 user nova-compute[73007]:  {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:27:01 user nova-compute[73007]: WARNING os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 18:27:01 user nova-compute[73007]: 
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6348b-b83c-4b4b-bb48-9372bbb3525c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7, portal: 172.16.0.220,3260]
Aug 15 18:27:01 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7, portal: 172.16.0.220,3260] successful.
Aug 15 18:27:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3457e392-515a-48a9-83dc-c773ef78cd83]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea426e-a974-464f-abee-e23fa2a10926]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 (non-flash)
Aug 15 18:27:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 (non-flash)
Aug 15 18:27:01 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a95e54a-ee6b-4316-ae61-80f0e77ab1c4]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:27:01 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAUdxrwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23838663236643536', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838663236643536', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG nova.objects.instance [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:27:02 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:27:02 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:27:02 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:27:02 user nova-compute[73007]:   <serial>6b04faa5-040d-45f5-ad74-269fb4b1c4d7</serial>
Aug 15 18:27:02 user nova-compute[73007]: </disk>
Aug 15 18:27:02 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No VIF found with MAC fa:16:3e:b2:29:76, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:27:02 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-cc864957-f260-4bcf-b71c-5b9afb337b18 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.324s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:27:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:27:04 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:27:04 user nova-compute[73007]: INFO nova.compute.manager [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Detaching volume 6b04faa5-040d-45f5-ad74-269fb4b1c4d7
Aug 15 18:27:04 user nova-compute[73007]: INFO nova.virt.block_device [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attempting to driver detach volume 6b04faa5-040d-45f5-ad74-269fb4b1c4d7 from mountpoint /dev/vdb
Aug 15 18:27:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Attempting to detach device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:27:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:27:04 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:27:04 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:27:04 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:27:04 user nova-compute[73007]:   <serial>6b04faa5-040d-45f5-ad74-269fb4b1c4d7</serial>
Aug 15 18:27:04 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:27:04 user nova-compute[73007]: </disk>
Aug 15 18:27:04 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:27:04 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully detached device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the persistent domain config.
Aug 15 18:27:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:27:04 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:27:04 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:27:04 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:27:04 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:27:04 user nova-compute[73007]:   <serial>6b04faa5-040d-45f5-ad74-269fb4b1c4d7</serial>
Aug 15 18:27:04 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:27:04 user nova-compute[73007]: </disk>
Aug 15 18:27:04 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692124025.2411685, db082eb4-3e62-4560-b11a-4bd412c7d016 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:27:05 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully detached device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the live domain config.
Aug 15 18:27:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAUdxrwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:27:05 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4110e64-8a2d-4800-baf7-5980f153e6d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36d9520-c1c3-4166-92c9-e76fba030609]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 (non-flash)
Aug 15 18:27:05 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 (non-flash)
Aug 15 18:27:05 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c57feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[febed60f-fc43-4dd9-8137-48c9fe9ba26d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[53533cc7-9565-4424-a531-abf3963ee92d]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[36425514-5759-4a19-a0a4-44261803d57b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0f3ae9-8135-4a7b-a563-0a0fe7b8bb14]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7708e-1b87-42b7-a08e-e21a297fa2cc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b059c9f-8305-4a54-a6ce-f1062a40da31]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7, portal: 172.16.0.220,3260]
Aug 15 18:27:05 user nova-compute[73007]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7, portal: 172.16.0.220,3260] successful.
Aug 15 18:27:05 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b04faa5-040d-45f5-ad74-269fb4b1c4d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[af03c82e-f085-467d-8fbf-46a90a3c1463]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.242s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== disconnect_volume: return (243ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:27:05 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:27:06 user nova-compute[73007]: DEBUG nova.objects.instance [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:27:06 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-52efcf17-e07c-403b-ac8f-85f84f4b1953 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.558s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:27:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:27:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:27:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:27:32 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:27:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:39 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:27:39 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:27:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.132526397705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance db082eb4-3e62-4560-b11a-4bd412c7d016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:27:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:42 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:43 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:27:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:27:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:27:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:27:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:45 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:27:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:27:54 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:27:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:27:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:27:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:27:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:27:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:27:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:27:58 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:27:58 user nova-compute[73007]: DEBUG nova.objects.instance [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:27:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:27:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:27:58 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:27:58 user nova-compute[73007]: INFO nova.compute.manager [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attaching volume eb712ca2-e3dc-4bbb-9d37-40fc477853da to /dev/vdb
Aug 15 18:27:59 user nova-compute[73007]: DEBUG os_brick.utils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b900e5c-6b67-42ad-ad6a-9ccd1471e433]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[847eb9fb-3a95-4221-bf96-15fd2d9571c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa7dc67-7d6a-4bea-8ff2-dc1f6dfa20c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[90685b0a-d53e-4646-909d-07ab04759afc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:27:59 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:27:59 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b06251-bcb4-49e5-a4ea-9b98651230ce]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG os_brick.utils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating existing volume attachment record: 19d1fb89-de85-40d7-a930-307ba987c4c1 {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:27:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:03 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXLZStnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:28:07 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:28:07 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:28:07 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1be48f1-779e-4040-a536-f1fe05b408c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:28:07 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22fbdab-667f-44a2-a1c0-4a32e2a9c9f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da] added
Aug 15 18:28:07 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d94b4e-5eb7-4956-9db0-0daf8d523328]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13096d0-35cb-4ed8-b9af-4e104d7ecf23]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXLZStnG {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXLZStnG" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c7a8e-8a97-41e8-af41-acd115e02fee]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MXLZStnG'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38b443c-a2ba-4d4f-a2af-c865a2e80933]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedabefa-da39-4539-bbdf-16ecf4552bb3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:28:07 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:28:07 user nova-compute[73007]:  {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:28:07 user nova-compute[73007]: WARNING os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 18:28:07 user nova-compute[73007]: 
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[86048c91-6fea-4389-9b91-85cd5adaccc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da, portal: 172.16.0.220,3260]
Aug 15 18:28:07 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da, portal: 172.16.0.220,3260] successful.
Aug 15 18:28:07 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1af83e8-f7cd-4b19-8f0d-d701771eec72]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc3f4b9-4269-4cd2-9172-a22e61b6852f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da (non-flash)
Aug 15 18:28:07 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da (non-flash)
Aug 15 18:28:07 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b34d8c3-489f-4159-8eba-52542144dfe6]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:28:07 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXLZStnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:28:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:28:08 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23164626538643764', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:28:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164626538643764', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:28:08 user nova-compute[73007]: DEBUG nova.objects.instance [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:28:08 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:28:08 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:28:08 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:28:08 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:28:08 user nova-compute[73007]:   <serial>eb712ca2-e3dc-4bbb-9d37-40fc477853da</serial>
Aug 15 18:28:08 user nova-compute[73007]: </disk>
Aug 15 18:28:08 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No VIF found with MAC fa:16:3e:b2:29:76, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-279a5239-34fb-4598-a11a-499094b10e8c tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.442s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:28:11 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:28:11 user nova-compute[73007]: INFO nova.compute.manager [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Detaching volume eb712ca2-e3dc-4bbb-9d37-40fc477853da
Aug 15 18:28:11 user nova-compute[73007]: INFO nova.virt.block_device [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attempting to driver detach volume eb712ca2-e3dc-4bbb-9d37-40fc477853da from mountpoint /dev/vdb
Aug 15 18:28:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Attempting to detach device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:28:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:28:11 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:28:11 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:28:11 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:28:11 user nova-compute[73007]:   <serial>eb712ca2-e3dc-4bbb-9d37-40fc477853da</serial>
Aug 15 18:28:11 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:28:11 user nova-compute[73007]: </disk>
Aug 15 18:28:11 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:28:11 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully detached device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the persistent domain config.
Aug 15 18:28:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:28:11 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:28:11 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:28:11 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:28:11 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:28:11 user nova-compute[73007]:   <serial>eb712ca2-e3dc-4bbb-9d37-40fc477853da</serial>
Aug 15 18:28:11 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:28:11 user nova-compute[73007]: </disk>
Aug 15 18:28:11 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692124092.0403135, db082eb4-3e62-4560-b11a-4bd412c7d016 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:28:12 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully detached device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the live domain config.
Aug 15 18:28:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXLZStnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:28:12 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a02ca1-d6ef-46eb-a2fc-65f97d10a13e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51654b8-4002-4983-9ff7-ae5b9f43e9c1]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da (non-flash)
Aug 15 18:28:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da (non-flash)
Aug 15 18:28:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1164bba8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[150b21ef-17e1-4b0f-9516-b7d9fc232e0f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42b3f47-7d3e-4f26-85b2-1007dd9d9a98]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb7829-a3bd-461d-9c36-7da96922e7c3]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c01f7c-b45c-4ea5-a4ba-b0750da2e85f]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca18c76-0c12-4194-ad38-eff36d793619]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eefaee-0363-41b0-8cae-d82caa3d44db]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da, portal: 172.16.0.220,3260]
Aug 15 18:28:12 user nova-compute[73007]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da, portal: 172.16.0.220,3260] successful.
Aug 15 18:28:12 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb712ca2-e3dc-4bbb-9d37-40fc477853da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd52b15-add1-45b2-ab97-9d5d0b8613fc]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== disconnect_volume: return (271ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:28:12 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:28:13 user nova-compute[73007]: DEBUG nova.objects.instance [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:28:13 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-a2b0340b-ece8-4ad7-98b8-3e2d85a84774 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.557s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:28:13 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:28:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:28:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:28:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:28:33 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:28:34 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:28:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:28:38 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:28:39 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:28:39 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:28:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.13156509399414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance db082eb4-3e62-4560-b11a-4bd412c7d016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:28:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:42 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:42 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:43 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:45 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:28:45 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:28:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:28:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:28:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:28:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:28:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:28:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:28:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:29:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:29:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:29:05 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:29:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:29:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:29:05 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:29:05 user nova-compute[73007]: INFO nova.compute.manager [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attaching volume 89fee411-490b-4768-b69d-aa0217161adb to /dev/vdb
Aug 15 18:29:06 user nova-compute[73007]: DEBUG os_brick.utils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[492a16a6-54c4-4426-8078-59fe3f8cdb9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5be13ce1766\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5a2372-ebde-4fe6-a851-9da09e07f159]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a362e1d-4363-4784-9ca3-6597d901852e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[855626ff-88df-4b00-a237-468a23141a39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Running cmd (subprocess): nvme version {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] 'nvme version' failed. Not Retrying. {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] nvme not present on system {{(pid=73007) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 18:29:06 user nova-compute[73007]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 18:29:06 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c8f536-53b8-4ded-95d3-f88e32579228]: (4, '') {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73007) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.lightos [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] LIGHTOS: no hostnqn found. {{(pid=73007) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG os_brick.utils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5be13ce1766', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:29:06 user nova-compute[73007]: DEBUG nova.virt.block_device [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating existing volume attachment record: 59c87b12-d109-4f63-8d1a-8b82ce8f2a3d {{(pid=73007) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 18:29:08 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:29:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:29:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Calling os-brick to attach iSCSI Volume {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzacuMOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:29:20 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:29:20 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:29:20 user nova-compute[73007]: INFO os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d7fd54-eb44-436f-9ffd-978ef11edbf1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 18:29:20 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --interface default --op new {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b5e67c-4857-444b-93cf-00259800a842]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb] added\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb] added
Aug 15 18:29:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1119419f-b6e5-4e20-ad79-64b3e695b7a9]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29a93a5-f069-48c1-80de-8da5fe5f423b]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzacuMOv {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzacuMOv" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba8a8fc-804f-497a-8f6e-de38b674e239]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jzacuMOv'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c14845-af7a-42a7-9be2-8a63cf91ae73]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a73595-a177-4a2f-9f8a-9b8b3868e298]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:29:20 user nova-compute[73007]:  {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 18:29:20 user nova-compute[73007]:  {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:29:20 user nova-compute[73007]: WARNING os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 18:29:20 user nova-compute[73007]: 
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --login {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43686c-1671-4438-9e45-d2fdaabdfcf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb, portal: 172.16.0.220,3260]
Aug 15 18:29:20 user nova-compute[73007]: Login to [iface: default, target: iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb, portal: 172.16.0.220,3260] successful.
Aug 15 18:29:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[211b4bf5-14cc-41db-bd57-fc1fa159f911]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[028b3736-b01e-4106-98df-a93acb0d8929]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb (non-flash)
Aug 15 18:29:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb (non-flash)
Aug 15 18:29:20 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Connected to 172.16.0.220:3260 {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73007) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73007) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3316a42a-d44a-4aff-b1fc-34d5ce74de7c]: (4, ('- - 0', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:20 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:29:21 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73007) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 18:29:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzacuMOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73007) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 18:29:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:29:21 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23138353537643964', 'path': '/dev/sdb'} {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:29:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138353537643964', 'path': '/dev/sdb'} {{(pid=73007) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 18:29:21 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:29:21 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 18:29:21 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:29:21 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:29:21 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:29:21 user nova-compute[73007]:   <serial>89fee411-490b-4768-b69d-aa0217161adb</serial>
Aug 15 18:29:21 user nova-compute[73007]: </disk>
Aug 15 18:29:21 user nova-compute[73007]:  {{(pid=73007) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 18:29:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vda, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:29:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73007) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 18:29:22 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] No VIF found with MAC fa:16:3e:b2:29:76, not building metadata {{(pid=73007) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 18:29:22 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ab048d8e-3343-457e-9fb7-75b91c9ab975 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.475s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:29:23 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:29:24 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:29:24 user nova-compute[73007]: INFO nova.compute.manager [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Detaching volume 89fee411-490b-4768-b69d-aa0217161adb
Aug 15 18:29:24 user nova-compute[73007]: INFO nova.virt.block_device [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Attempting to driver detach volume 89fee411-490b-4768-b69d-aa0217161adb from mountpoint /dev/vdb
Aug 15 18:29:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Attempting to detach device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the persistent domain config. {{(pid=73007) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 18:29:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:29:24 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:29:24 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:29:24 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:29:24 user nova-compute[73007]:   <serial>89fee411-490b-4768-b69d-aa0217161adb</serial>
Aug 15 18:29:24 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:29:24 user nova-compute[73007]: </disk>
Aug 15 18:29:24 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:29:24 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully detached device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the persistent domain config.
Aug 15 18:29:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the live domain config. {{(pid=73007) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 18:29:24 user nova-compute[73007]: DEBUG nova.virt.libvirt.guest [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 18:29:24 user nova-compute[73007]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 18:29:24 user nova-compute[73007]:   <source dev="/dev/sdb"/>
Aug 15 18:29:24 user nova-compute[73007]:   <target dev="vdb" bus="virtio"/>
Aug 15 18:29:24 user nova-compute[73007]:   <serial>89fee411-490b-4768-b69d-aa0217161adb</serial>
Aug 15 18:29:24 user nova-compute[73007]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 18:29:24 user nova-compute[73007]: </disk>
Aug 15 18:29:24 user nova-compute[73007]:  {{(pid=73007) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-0ad3e6cf-ce22-44b8-a1b7-07be9083dfa9 None None] Received event <DeviceRemovedEvent: 1692124165.3099236, db082eb4-3e62-4560-b11a-4bd412c7d016 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73007) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.driver [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 18:29:25 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully detached device vdb from instance db082eb4-3e62-4560-b11a-4bd412c7d016 from the live domain config.
Aug 15 18:29:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] calling os-brick to detach iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f11505d1a80>, {'target_iqns': ['iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzacuMOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 18:29:25 user nova-compute[73007]: WARNING os_brick.initiator.connectors.base [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb', 0)] {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[3469c0b2-5176-46a3-9740-a5e890876f31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[19539fdb-41e1-4da1-ae8c-2f7c15856a26]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb (non-flash)\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb (non-flash)
Aug 15 18:29:25 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb (non-flash)
Aug 15 18:29:25 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f112c79cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb'): ({'sdb'}, set())}) {{(pid=73007) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Removing single pathed devices sdb {{(pid=73007) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e0552a-dd8a-4041-832b-5cf22f1cdf5f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d5f709-9994-40fd-94a4-c37967c42e47]: (4, ('ok\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Flushing IO for device /dev/sdb {{(pid=73007) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51f432f-98a6-49a0-ae0b-9c0b86639095]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73007) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046f295-9c0a-4c2c-8d9b-ccbb694c9119]: (4, ('1', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.linuxscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] SCSI volumes sdb have been removed. {{(pid=73007) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb')] {{(pid=73007) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eafe8a4-1800-46e4-a622-76cf4462748f]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --logout {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d06c08-187c-4202-9c93-113bfd537497]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb, portal: 172.16.0.220,3260]
Aug 15 18:29:25 user nova-compute[73007]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb, portal: 172.16.0.220,3260] successful.
Aug 15 18:29:25 user nova-compute[73007]:  stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op delete {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89fee411-490b-4768-b69d-aa0217161adb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84257) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG oslo.privsep.daemon [-] privsep: reply[482d99a3-a0e2-40d9-8f2f-ecf8c0ec35a8]: (4, ('', '')) {{(pid=84257) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73007) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.base [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG os_brick.initiator.connectors.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] <== disconnect_volume: return (252ms) None {{(pid=73007) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 18:29:25 user nova-compute[73007]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Disconnected iSCSI Volume {{(pid=73007) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 18:29:26 user nova-compute[73007]: DEBUG nova.objects.instance [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'flavor' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:29:26 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-49623eb0-7a06-4257-a584-1f0fbd1602f0 tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:29:28 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:30 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 18:29:30 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] There are 0 instances to clean {{(pid=73007) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 18:29:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:29:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:29:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:39 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:29:40 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:29:41 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:29:41 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.130504608154297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance db082eb4-3e62-4560-b11a-4bd412c7d016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing inventories for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating ProviderTree inventory for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Updating inventory in ProviderTree for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing aggregate associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, aggregates: None {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Refreshing trait associations for resource provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d, traits: HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=73007) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:29:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:29:43 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:43 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:43 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73007) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 18:29:44 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:29:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:45 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:46 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:46 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:29:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:59 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:29:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:29:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:29:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:29:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:29:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:30:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:30:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:12 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:30:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:35 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquired lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Forcefully refreshing network info cache for instance {{(pid=73007) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG nova.objects.instance [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lazy-loading 'info_cache' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG nova.network.neutron [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [{"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Releasing lock "refresh_cache-db082eb4-3e62-4560-b11a-4bd412c7d016" {{(pid=73007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 18:30:36 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updated the network info_cache for instance {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 18:30:37 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Triggering sync for uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 18:30:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:30:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:30:37 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:30:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:30:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 18:30:41 user nova-compute[73007]: DEBUG oslo_concurrency.processutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73007) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 18:30:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:30:42 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:30:42 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.12967300415039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Instance db082eb4-3e62-4560-b11a-4bd412c7d016 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73007) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:30:42 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:30:44 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:44 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:30:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:30:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:46 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:47 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:30:47 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:30:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:30:53 user nova-compute[73007]: INFO nova.compute.manager [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Terminating instance
Aug 15 18:30:53 user nova-compute[73007]: DEBUG nova.compute.manager [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Start destroying the instance on the hypervisor. {{(pid=73007) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:53 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-4295b02c-bf9a-4796-adc9-24e83a8e948c req-cc677464-efa8-421b-aa53-44cf78f8d84b service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received event network-vif-unplugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4295b02c-bf9a-4796-adc9-24e83a8e948c req-cc677464-efa8-421b-aa53-44cf78f8d84b service nova] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4295b02c-bf9a-4796-adc9-24e83a8e948c req-cc677464-efa8-421b-aa53-44cf78f8d84b service nova] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-4295b02c-bf9a-4796-adc9-24e83a8e948c req-cc677464-efa8-421b-aa53-44cf78f8d84b service nova] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-4295b02c-bf9a-4796-adc9-24e83a8e948c req-cc677464-efa8-421b-aa53-44cf78f8d84b service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] No waiting events found dispatching network-vif-unplugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.compute.manager [req-4295b02c-bf9a-4796-adc9-24e83a8e948c req-cc677464-efa8-421b-aa53-44cf78f8d84b service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received event network-vif-unplugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 for instance with task_state deleting. {{(pid=73007) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [-] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Instance destroyed successfully.
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.objects.instance [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lazy-loading 'resources' on Instance uuid db082eb4-3e62-4560-b11a-4bd412c7d016 {{(pid=73007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.virt.libvirt.vif [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T18:23:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-169455221',display_name='tempest-SnapshotDataIntegrityTests-server-169455221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-169455221',id=53,image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkB6UWD7+gBrZETOOKKoDPtUhdla4bYVjIIOOurNwdDG6BOwup8RNogp0cOdqZ3U61y0qIJskImGcKL1PLL88cnEGPb3zNTxyc+bA1gxUbuqnRRFTIKEYsLHxC4W3/Tzw==',key_name='tempest-keypair-575523738',keypairs=<?>,launch_index=0,launched_at=2023-08-15T18:23:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f684adf0d3d4647abbad2d3323b6e77',ramdisk_id='',reservation_id='r-tt4u1pry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ebea4084-739d-4b93-af7c-d6ebe6897cd3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-878809701',owner_user_name='tempest-SnapshotDataIntegrityTests-878809701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T18:23:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62d668a06574a56a6d50fbeed314a04',uuid=db082eb4-3e62-4560-b11a-4bd412c7d016,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Converting VIF {"id": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "address": "fa:16:3e:b2:29:76", "network": {"id": "617ca2de-53ec-4800-b212-19cbc09427b0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1915578223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f684adf0d3d4647abbad2d3323b6e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fb9d2a0-2b", "ovs_interfaceid": "3fb9d2a0-2bb3-4dce-be6d-a168fa346b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.network.os_vif_util [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:29:76,bridge_name='br-int',has_traffic_filtering=True,id=3fb9d2a0-2bb3-4dce-be6d-a168fa346b29,network=Network(617ca2de-53ec-4800-b212-19cbc09427b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb9d2a0-2b') {{(pid=73007) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG os_vif [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:29:76,bridge_name='br-int',has_traffic_filtering=True,id=3fb9d2a0-2bb3-4dce-be6d-a168fa346b29,network=Network(617ca2de-53ec-4800-b212-19cbc09427b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb9d2a0-2b') {{(pid=73007) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fb9d2a0-2b, bridge=br-int, if_exists=True) {{(pid=73007) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:30:54 user nova-compute[73007]: INFO os_vif [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:29:76,bridge_name='br-int',has_traffic_filtering=True,id=3fb9d2a0-2bb3-4dce-be6d-a168fa346b29,network=Network(617ca2de-53ec-4800-b212-19cbc09427b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fb9d2a0-2b')
Aug 15 18:30:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Deleting instance files /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016_del
Aug 15 18:30:54 user nova-compute[73007]: INFO nova.virt.libvirt.driver [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Deletion of /opt/stack/data/nova/instances/db082eb4-3e62-4560-b11a-4bd412c7d016_del complete
Aug 15 18:30:54 user nova-compute[73007]: INFO nova.compute.manager [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 18:30:54 user nova-compute[73007]: DEBUG oslo.service.loopingcall [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73007) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.compute.manager [-] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Deallocating network for instance {{(pid=73007) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 18:30:54 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] deallocate_for_instance() {{(pid=73007) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 18:30:55 user nova-compute[73007]: DEBUG nova.network.neutron [-] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Updating instance_info_cache with network_info: [] {{(pid=73007) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 18:30:55 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Took 1.27 seconds to deallocate network for instance.
Aug 15 18:30:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:30:55 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:30:56 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:30:56 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:30:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:30:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-59937757-7131-4379-83a7-8791475e8352 req-73fcc396-69ea-4a1c-80ef-7c4f85934ba7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received event network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:30:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-59937757-7131-4379-83a7-8791475e8352 req-73fcc396-69ea-4a1c-80ef-7c4f85934ba7 service nova] Acquiring lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:30:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-59937757-7131-4379-83a7-8791475e8352 req-73fcc396-69ea-4a1c-80ef-7c4f85934ba7 service nova] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:30:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [req-59937757-7131-4379-83a7-8791475e8352 req-73fcc396-69ea-4a1c-80ef-7c4f85934ba7 service nova] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:30:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-59937757-7131-4379-83a7-8791475e8352 req-73fcc396-69ea-4a1c-80ef-7c4f85934ba7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] No waiting events found dispatching network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 18:30:56 user nova-compute[73007]: WARNING nova.compute.manager [req-59937757-7131-4379-83a7-8791475e8352 req-73fcc396-69ea-4a1c-80ef-7c4f85934ba7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received unexpected event network-vif-plugged-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 for instance with vm_state deleted and task_state None.
Aug 15 18:30:56 user nova-compute[73007]: DEBUG nova.compute.manager [req-59937757-7131-4379-83a7-8791475e8352 req-73fcc396-69ea-4a1c-80ef-7c4f85934ba7 service nova] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Received event network-vif-deleted-3fb9d2a0-2bb3-4dce-be6d-a168fa346b29 {{(pid=73007) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 18:30:56 user nova-compute[73007]: INFO nova.scheduler.client.report [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Deleted allocations for instance db082eb4-3e62-4560-b11a-4bd412c7d016
Aug 15 18:30:56 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-ac014890-f048-4478-a551-5f936b05565e tempest-SnapshotDataIntegrityTests-878809701 tempest-SnapshotDataIntegrityTests-878809701-project-member] Lock "db082eb4-3e62-4560-b11a-4bd412c7d016" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.522s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:30:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:31:09 user nova-compute[73007]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692124254.5428085, db082eb4-3e62-4560-b11a-4bd412c7d016 => Stopped> {{(pid=73007) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 18:31:09 user nova-compute[73007]: INFO nova.compute.manager [-] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] VM Stopped (Lifecycle Event)
Aug 15 18:31:09 user nova-compute[73007]: DEBUG nova.compute.manager [None req-2da41785-b7a8-4003-a8a9-3fea085557ce None None] [instance: db082eb4-3e62-4560-b11a-4bd412c7d016] Checking state {{(pid=73007) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 18:31:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:31:14 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:31:19 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:24 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:31:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:31:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:31:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:31:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:31:29 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:31:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:31:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:31:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:31:34 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:37 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Starting heal instance info cache {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 18:31:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Rebuilding the list of instances to heal {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 18:31:37 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Didn't find any instances for network info cache update. {{(pid=73007) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 18:31:37 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:39 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:31:40 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Auditing locally available compute resources for user (node: user) {{(pid=73007) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 18:31:41 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:31:41 user nova-compute[73007]: WARNING nova.virt.libvirt.driver [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 18:31:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.157062530517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73007) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73007) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG nova.compute.provider_tree [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed in ProviderTree for provider: 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d {{(pid=73007) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG nova.scheduler.client.report [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Inventory has not changed for provider 2c62a5a4-d74d-43ad-a53c-fdd8c74e177d based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73007) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG nova.compute.resource_tracker [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Compute_service record updated for user:user {{(pid=73007) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 18:31:41 user nova-compute[73007]: DEBUG oslo_concurrency.lockutils [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=73007) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 18:31:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:44 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:45 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:45 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:47 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:48 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:49 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:31:49 user nova-compute[73007]: DEBUG nova.compute.manager [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73007) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 18:31:49 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:51 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:54 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:31:59 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:32:01 user nova-compute[73007]: DEBUG oslo_service.periodic_task [None req-accb8958-8f45-470a-bbd0-59403a494ba1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73007) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 18:32:04 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:32:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 18:32:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 18:32:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73007) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 18:32:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:32:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73007) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 18:32:09 user nova-compute[73007]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=73007) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}